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WO 99/39255 PCT/US99/02227 

TEXT PROCESSOR 

Reference to Prior Application 
This application is a continuation-in-part of co-pending 
Application Serial No. 08/693,444, filed August 7, 1996. 
5 FIELD OF THE INVENTION 

The present invention relates to computer assisted text 
presentation. More specifically, the invention relates to 
enhanced text presentation using content specific attributes 
to improve the reading experience. 

10 

BACKGROUND OF THE INVENTION 
The purpose of reading is to make an impact on the mind 
of the reader. This is true whether the text being read 
comprises a novel or a heads-up aircraft display. Material 

15 presented in a non-textual medium conveys information well 
suited to human absorption beyond the corresponding, one- 
dimensional text. Still pictures present object attributes 
such as colors, relative sizes, relative locations, patterns, 
groupings, and hierarchies. An object is viewed in a 

20 context. For example, a picture of a small object located 
with others in a corner conveys different information than 
the same object, enlarged, by itself, and in the center. 
Beginning sentences and paragraphs add contextual information 
by their location alone. Moving pictures have movement and 

25 temporal change as added attributes. Much information comes 
into the brain visually and through pattern recognition. 
Other information comes as audio information, conveying 
information through tone, changing inflection, and changing 
volume level. 

3 0 Computer presentation of text for human reading has 

failed to utilize much of the human brain. As a result, only 
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a part or the possible bandwidth is utilized, and computer 

text presentation is often thought of as unfriendly, 

constant, mechanical, and generally lacking in some way. 

When given the choice, most people prefer to read a book-in 
5 print rather than a book on a computer screen. Current 

computer text presentation is poor relative to a book, and 

even poorer relative to its" potential . 

Some " work has been done in computerized text 

presentation. Huanng (U.S. Patent No. .4,880,385) discloses 
10 an opto-mechanical speed reading device that allows viewing 

text printed on paper through a viewing window one line , at 
' a time, automatically advancing lines. 

Advances have been made in methods for the computerized 

parsing of natural language into parts of speech. Schabes 
15 et al . (U.S. Patent No. 5,475,588), disclose an improved 

parsing system for creating parse trees. Black, Jr. et al . 

(U.S. Patent No. 5,331, 556) disclose a method for storing 

parts of speech information in a file along. with the original 

text for improved subsequent searching of the text . Okamoto 
20 et al. (U.S. Patent No. 4,661,924), and Church (U.S. Patent 
. No. .5,146,405) disclose methods for disambiguating multiple- 

parts-of -speech. Zamora et al . (U.S. Patent No. 4,887,212), 

van Vliembergen (U.S. Patent No. 5,068,789) ,_■ Hemphill et al . 

(U.S. Patent No. 5,083,268) disclose methods for parsing 
25 natural language text. All of the above cited patents are 

herein incorporated by reference. 

Reading is a complex process and there are many factors 

that determine differences in reading performance between 

readers and even for the same reader on different occasions. 
3 0 These include innate neurophysiological conditions such as 

dyslexia, but also age; behavioral and motivational factors; 
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level or education and prior reading practice; and perceptual 
constraints. A reader may also have different reading 
objectives that will affect how he/she approaches the reading 
material. Despite all of the above, text is presented by 
5 computers, at worst, as one dimensional "beads on a string", 
at best, similar to the two dimensional text presented by 
books. Indeed, whether text is presented in print or on an 
electronic display matters little because the text 
presentation is essentially identical. 
10 Examples of the constant presentation of text are 

numerous . Topic sentences are presented the same as other 
sentences in a paragraph. Technical words are presented no 
different than non- technical words. Adjectives appear the 
same as nouns. Educationally difficult terms are presented 
15 the same as simple terms. The last paragraph in a chapter 
is presented the same as the first paragraph. Text is 
presented in left justified, broken lines of constant width 
requiring a jerking eye movement from far right to far left 
at regular intervals. Text is broken in mid- sentence , mid- 
20 phrase and mid- thought, applying ancient typesetting rules. 
Such text forces the eye to travel back and forth over large 
distances, mimicking a typewriter carriage. Text is advanced 
manually, broken into chunks determined by how many lines can 
fit on the screen. 

2 5 There are several good reasons for not placing only one 

enhanced sentence per page in a book. These reasons may have 
been inappropriately carried over into the computer display 
of text . The possibility of modifying text presentation to 
enhance the reader's ability to read text by harnessing the 

3 0 power of digital manipulation appears to have been overlooked 

by those most knowledgeable in computing. 
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What would be desirable is a method for displaying the 
location of text with in relation to the text hierarchies 
within which the text resides. A method for displaying text 
on opposed pages which allows reading text without waiting 
5 for page changes would also be desirable. A text display 
system making use of the natural human ability and preference 
to move forward while viewing objects would be useful. A 
method for displaying text using quantitative color 
modification to transparently represent the cumulative 
10 relationships between larger sentence fragments and the words 
within would be desirable. 



In order to preserve all of the information in an 
15 author-written text, text presentation, by definition, must 
systematically present the sequence of words written by the 
author in an unambiguous structure. It is also desirable 
that the additional information to be depicted in enhanced 
text presentation for improved reading would be incorporated 
20 into the requisite processes of text presentation itself, 
(i.e., placing characters against a contrasting background 
at various locations in space and time), rather than 
introducing additional symbols that require additional 
learning, reading and interpretation by the reader. 

25 

SUMMARY OF THE INVENTION 
The present invention is directed to a text enhancement 
method and apparatus for the presentation of text for 
improved human reading. The invention includes extracting 
3 0 text specific attributes from machine readable text, ■ varying 
the text presentation in accordance with the attributes, and 
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creating a three dimensional (time and reading surface) 
visual product for enhancing the reading experience. The 
preferred embodiment of the invention extracts attributes 
such as parts of speech from an input sentence and displays 
5 that sentence in cascading text segments down and across the 
screen. The segmentation and horizontal displacement is 
determined by applying rules which utilize parts of speech, 
punctuation, and reader-preferences. The color of the text 
and background can also be varied depending on the parts of 

10 speech and on the position of sentences within paragraphs and 
paragraphs within chapters. 

The invention adds meaningful visual attributes to 
enhance the presentation of computer displayed text above the 
constant and mechanical textual display of current systems. 

15 A meaningful visual cue is created that relates to - the 
content of the new phrase and its relationship to the 
previous phrase. This cue is available before the text is 
read, giving context to the text. The sentence parsing 
processing uses the sentence's punctuation and content to 

2 0 create a system of meaningful visual cues including distinct 
phrases which promotes quicker recognition of the words in 
a phrase and their meanings . The enhanced sentence cascades 
down the page in a pattern of meaningful phrases determined 
by text content and reader preferences, the eyes moving a 

25 short distance from phrase to phrase. 

A sentence represents a complete thought, and a 
paragraph represents a discrete subject or argument. Reading 
comprehension improves when one sentence appears at a time 
and when the transition from one paragraph to another is 

30 visually signalled and includes a pause for the appearance 
of these elements of text. The invention creates appropriate 
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visual attributes . to provide these visual signals. The 
visual attributes can include text segmentation, horizontal 
displacement of one line relative to another, text and 
background color, text brightness, and animation. The 
5 animation can include blinking and swiping, the time 
dependent, temporary, progressive brightening of elements of 
text, and the movement of text from standard to cascaded 
presentation. 

In an exemplary reading session, the reader selects text 

10 to read, and informs the reading system the text type, e.g. 
a novel. The reading system retrieves the proper environment 
previously stored for that reader reading that selected text 
type. The reader has the opportunity to . edit the reading 
rules and word sets but declines. Starting at the beginning 

15 of a chapter, where the reader left off, text is presented, 
one .sentence at a time, cascaded down and across the screen. 
As the lines displayed are broken into meaningful text 
segments rather than arbitrarily ending . at 80 characters, 
"reading and comprehending an entire segment at a time is 

2 0 possible, with the resulting eye movement being from center 
of text segment to center of text segment, down and across 
the screen. The sentence background color is a function of 
the sentence position within the paragraph and the paragraph 
position within the chapter. Each of the sentences in a 

2 5 paragraph may have the same hue, but have incremental, but 
discernable changes in color saturation or darkness between 
sentences, and incremental, but discernible changes in hue 
between paragraphs . The background color thus provides non- 
literal positional information, signalling the beginning and 

30 end of a paragraph, and the beginning and end of a chapter. 
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Sentences are segmented according to reader approved 
rules. Each preposition folds a phrase in a predictable way, 
resulting in two text segments, each lying on a new line. 
The content of the line above effects the horizontal 
5 displacement of the line below. The same preposition folds 
and horizontally displaces text the same way whenever 
possible. As a result, the same preposition causes a similar 
pattern, long since familiar to the reader. Parts of speech 
effect the text color according to reader approved rules. 

10 As a result, both sentence structure and parts of speech are 
immediately recognizable from pattern and color recognition, 
even before a word of text is recognized, providing visual, 
non-literal cues to the reader. 

The sentences advance at a rate using a rule previously 

15 selected by the reader. The formula is a function of the 
text type, number or words, educational level, and number of 
syllables present in the line. The advancement rate is a 
little faster than the reader's comfortable rate, to increase 
comprehension. A longer pause between sentence presentations 

20 signals a new paragraph before it appears. The reader is 
able to easily interact with the reading system, holding 
difficult sentences on the screen longer, and speeding up or 
slowing down the presentation. 

The above described exemplary reading session is 

25 exemplary, not limiting or exhausting the possible 
embodiments within the scope of the invention. 

The enhancement process exploits the fact that the 
elements of text have non-literal qualities that can be used 
to produce a text presentation product in time and in space 

30 that is more meaningful and enhances the reader's ability to 
comprehend the literal meaning of the text to a greater 
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degree tnan existing formats on computers or paper. The 
cascading of phrases down and across the screen imparts a 
visual corollary as to how the text might be experienced if 
heard from a live reading, without the reader having to 
5 subvocalize it. Reading such an enhanced text is almost like 
listening with the eyes, but as a total visual packet that 
is experienced almost simultaneously. 

Another aspect of the invention includes recording, 
actions of a reader-performer reading a text aloud and can 

10 include the recording of speaking , hand movement, eye 
movement, head movement, and mouth movement. The actions are 
preferably recorded and; mapped to corresponding words in the 
text. The text display can be varied in accordance with the 
recorded actions. The text display attributes can include 

15 text displacement, font height, font thickness, inter- 
character spacing, inter-word spacing, and interline spacing. 

Another aspect of the invention displays the location 
.of text relative to the text unit hierarchies within which 
it resides by varying the tiling of planes or windows. The 

20 windows or planes representing the various hierarchies are 
tiled as a function . of the rank of the text unit within the 
hierarchy. ■ One embodiment alternately horizontally and 
vertically tiles the window sets for the text unit 
hierarchies, 

2 5 Another aspect of the invention displays text on opposed 

pages such that reading of text across the opposed pages can 
occur without waiting for pagination. One. method replaces 
the text content of each opposed page as the opposed page is 
read, without waiting for both opposed pages to be- read. 

3 0 Yet another aspect of the invention displays text having 

an original, text sequence, from bottom to top, in 
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perspective, such that reading the text from bottom to top 
appears to read the text from front to back. One embodiment 
scrolls -the text smoothly forward such that the reader seems 
to be moving forward through the text while reading the text . 
5 Still another aspect of the invention calculates the 

relationship between words and the larger text segments of 
which they are apart . One embodiment begins with a sentence 
and repeatedly subdivides the sentence into segments 
according to the relationships between the segments and sub- 
10 segments. The relationship between the segments and sub- 
segments is used to calculate a color value. The generation 
or level or recursion in the segmentation algorithm is also 
used to determine the color value. The calculated color 
value is used to display the color or each word or phrase. 
15 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a high-level flow-chart of a method utilized 
in an embodiment of the invention; 

FIG. 2 is a table illustrating various attributes of the 
elements in one sentence; 
20 FIG. 3 contains an example of enhanced text including 

cascade and right descent angles; 

FIG. 4 presents the sentence of FIG. 3 as enhanced text 
including cascade and right and left descent angles; 

FIG. 5 illustrates step 110 in detail; 
25 FIG. 6 illustrates word sets establishing a hierarchy 

of secondary folding points; 

FIG. 7 illustrates folding point locations in a 
sentence; 

FIG. 8 illustrates step 136 in detail; 
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PIG. 9 illustrates the sentence of FIG. 7 presented as 
enhanced text ; 

FIG. 10 illustrates a Presentation Interval Sampling 
History Map, wherein the time needed to read is a function 
5 of sentence difficulty and complexity; and 

FIG. 11 illustrates the sentence of FIG. 7 showing 
visual pronunciation of emphasized syllables. 

FIG. 12 is a chart illustrating lanes and slots used in 
calculating horizontal displacement; 
10 FIG. 13 illustrates a curve suitable for text bending; 

FIG. 14 illustrates rules for placement of text segments 
upon the curve of FIG. 13 as a function of the segment head 
and tail text attributes; 

FIG. 15 illustrates an intermediate result of a text 
15 bending algorithm; 

FIG. 16 illustrates several bent text segments formed 
over curves in accordance with. FIG. 14 and FIG. "15; 

FIG. 17 illustrates a computer display having a book on 
a computer display prior to opening; 

2 0 FIG. 18 illustrates a computer display showing the book 

of FIG. 17 after opening, exposing the chapters within; 

FIG. 19 illustrates a computer display having the 
chapters of FIG. 18 after selection. of a chapter, exposing 
the pages within; 
25 FIG. 19A illustrates an alternate embodiment ' computer 

display having the chapters of FIG. 18 after selection of a 
chapter, exposing the pages within; 

FIG. 20 illustrates a computer display having the pages 
of FIG. 19 after selection of a page, exposing the paragraphs 

3 0 within; 
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FIG. 21 illustrates a computer display having the 
paragraphs of FIG. 20 after selection of a sentence, exposing 
the sentences within; 

FIG. 22 illustrates a computer display having a cascaded 
5 sentence on a page selected in FIG. 21; 

FIG. 23 illustrates a method for displaying text across 
multiple display pages; 

FIG. 24 illustrates another method for displaying text 
across multiple display pages; 
10 FIG. 25 illustrates a method for displaying text which 

enables reading from front to back, from bottom to top, and 
which can be made to appear to move forward; 

FIG. 26 illustrates the text of FIG. 25 after forward 
movement of the text; and 
15 FIG. 27 is a tree diagram of a sentence subdivided for 

color assignment and prose painting. 
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• DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
FIG.. 1 shows a high-level flow-chart of a method 
utilized in an embodiment of the invention. The steps in 
5 FIG. 1 and all such figures may of course be split into 
additional steps or merged into fewer steps and still 
describe the same embodiment. 

In step 102, the reading device is started, and passed 
the identification (ID) of the reader and the text file 

10 identification to be read. In a preferred embodiment, the 
reader ID is obtained from the operating system. In another 
embodiment the reader is prompted for identification. In one 
embodiment, there is but one reader of the device assumed. 
Given the reader ID, reader specified parameters are 

15 retrieved in step 104 . Parameters are discussed in detail 
below. Given the text ID, the text file and text specific 
parameters are retrieved in step 104. In a preferred 
embodiment, the parameters have default values, and do not 
require reader entry. In a most preferred embodiment, entry 

2 0 of reader preferred specific parameters is allowed, values 
accepted, and the parameter values stored as in step 108. 
In one embodiment, the user is allowed to pull down menus 
containing dialog boxes, view default parameters, and modify 
them using standard user interfaces including numerical 

25 entry, text entry, slide bars, and buttons. In a preferred 
embodiment, given suitable access permission, modification 
of global parameters applying to all readers of the text is 
also allowed. The reader is allowed to have parameters set 
for only the current text., all texts of the same type as the 

30 current text, or all texts read by this reader. 
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Reader specific parameters include: viewing field 
dimensions; color palette for background and text; word set 
inputs for rules; minimum phrase length; maximum line length; 
minimum and maximum text segment weight; descent angles; 
5 horizontal displacement rule inputs; horizontal 
justification preferences; inter-phrase gap length; 
advancement rate; inter- sentence and inter paragraph interval 
proportions; Tagging definitions; animation specifications; 
definitions of parameters to derive content dependent 
10 presentation intervals; definitions of parameters and 
weighting to derive phrase/text matter, weight, density, 
complexity, and content; and identities of special event 
scripts . 



15 Viewing Field Dimensions 

Viewing field dimensions can specify the size of the 
window for viewing text in the two X and Y dimensions and a 
third dimension, time. This field can include the entire 
screen or a smaller portion of the screen. The time 

20 dimension can include the time over which time dependent 
animations such as blinking occur. 



Color Palette 

Color palette for background and text allows 
25 specification of preferred background and text color that 
varies with the text. In a preferred embodiment, the hue and 
brightness of the background color vary with both sentence 
position within a paragraph, and paragraph position within 
a chapter. In a most preferred embodiment, the brightness 
3 0 is set at one level for the first sentence in a paragraph and 
a second level for the last sentence in the paragraph, with 
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cli'e brightness of each sentence in between progressing from 
the first level to the second level. In a preferred 
embodiment, the background hue is set at a first value for 
the first paragraph in a chapter and a second value for the 
5 last paragraph in a chapter, with the hue of each paragraph 
progressing from the first value to the second value. In a 
most preferred embodiment, the first hue is green and the 
second hue is violet . 

In preferred embodiments, text, color can vary with a 

10 word's categorical and continuous attributes. A categorical 
attribute is a function of the category a word fits into. 
In a most preferred embodiment, categories include parts of 
speech e.g. verb, and technical words. Continuous attributes 
include those that can be measured such as educational level 

15 e.g. twelfth grade, number of syllables, and word length. 
In a preferred embodiment, different parts of speech have 
different text colors. In a most preferred embodiment, text 
color is varied with background color to provide optimal, 
reader-preferred -contrast . 

2 0 Word sets can be used to specify some parts of speech. 

For example, "I" is a pronoun, "had" is a verb, "a" is an 
article, -and "farm" could be a noun, verb, or adjective. 
The parts of speech need only be likely parts of speech as 
with the word "farm", which could be a noun, verb, or 
25 adjective. An example of the parts of speech in a single 
sentence is shown in FIG. 2. The multiple possible parts of 
speech column 150 is shown. as is the disambiguated part of 
speech column 152. 

Word sets are- input in preferred embodiments utilizing 

3 0 two methods. The first method utilizes a structured text 

format such as Standard Generalized Mark-Up Language (SGML) , 
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allowing for import and export of large word sets and 
dictionaries from diverse sources. Standard SGML parsers are 
then utilized to store the word sets in a suitable database. 
The second method allows interactive editing of word sets 
5 using a hierarchy of pull menus and dialog boxes . In a 
preferred embodiment, the reader specified word sets are 
stored in a separate database from the dictionary or glossary 
word sets, to allow for separate storage, editing and faster 
retrieval . 

10 

Minimum Text Segment Length & Maximum Line Length 
A preferred embodiment includes a reader specified 
minimum text segment length. A text segment is a piece of 
text that is presented on one line on a display. The minimum 

15 text segment length, which can be denominated in words, is 
the minimum the reader wishes to see on a separate line. A 
maximum line length is the maximum length the reader wishes 
to see on one line. Lengths can be measured in number of 
characters, words, syllables, educational level, or any sum 

20 of products of these. In one embodiment, the minimum line 
length is ten characters and the maximum line length is 
thirty five characters. 

Phrase Weight 

25 Phrase weight is a derived attribute of a phrase (text 

segment or potential text segment) giving some measure of the 
amount of material in a phrase. In one embodiment, the 
phrase weight is simply the number of words in a phrase. In 
preferred embodiment, phrase weight includes phrase density 

3 0 and phrase complexity. Phrase density can include the number 
of technical words or number of words exceeding a certain 
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grade level. . Phrase . complexity 'can include the number of 
spelling similarities between words in a phrase, number of 
ambiguous words, and total weight of reader weight -specified 
words . 

5 

Minimum and Maximum Text Segment Weight 
A preferred embodiment includes a reader specified 
minimum and maximum text segment weight . The text segment 
weight, is the quantity of text the reader wishes to see on. 
10 a separate line. In preferred embodiments, the text segment 
weight is the sum of phrase weights within the text segment. 

Horizontal Justification Rules 
Horizontal justification rules specify the horizontal 

15 justification of a line of text relative to the line above. 
Justification can include the justification type for the line 
or phrase being positioned, i.e. right, left, or center 
justification. Justification can also include the text 
portion of the line above from which the justification is 

2 0 measured, i.e. the entire line of text versus or one phrase, 
the point of that portion used, e.g'. left-most, right-most, 
or. center. Horizontal justification in one embodiment is 
simply measured within the line being positioned rather than 
relative to the line above. 

25 In a preferred embodiment, the first phrase on a line 

is center justified, measured from the center of. the . last 
phrase in the line immediately above. In another embodiment, 
the entire line of text is center justified below the center 
of the line of text above. In yet another embodiment, the 

30 text segment ''center of gravity", calculated using the 
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di'tticulty of each word, is used as the text segment center 
for justification purposes. 

Descent Angle 

5 A descent angle is the amount of horizontal displacement 

for each new line, modifying the horizontal position called 
for by the horizontal justification rules alone. By 
definition, each text segment is presented on a new line. 
In a preferred embodiment, the descent angle is specified in 

10 units of characters. The descent angle and horizontal 
justification at least partially determine the "text cascade" 
down and across the screen in preferred embodiments. An 
example of cascading text is illustrated in FIGS . 3 and 4. 
A descent angle may be zero, meaning that, without more, the 

15 text segment horizontal position is determined by the 
horizontal justification rules alone. A descent angle can 
be left, where the line below is to be shifted left relative 
to the line above, or right, where the text shifts right. 
FIG. 3 illustrates only right descent angles. 

20 In one embodiment, the decent angle in a constant for 

each new line. In a preferred embodiment, the descent angle 
is a function of the text segment weight of the line above. 
In another preferred embodiment, horizontal justification 
rules call for center justification below the center of each 

25 line immediately above, and the descent angle is calculated 
to present a substantially straight path, when all text lines 
are presented, from center of line to center of line, from 
upper left to lower right on the display surface. 

In a preferred embodiment, the inputs to descent angle 

30 rules include attributes of the text in the line above. In 
one preferred embodiment, inputs include the reason for 
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folding the line above, i.e. primary folding point, secondary 
folding point, or collapse rule. In a preferred embodiment, 
a more positive descent angle is called for when the line 
immediately above folded due to a primary folding point than 
5 a secondary folding point. In another preferred embodiment, 
the inputs include the text segment weight of the current 
line and the line above. . 

It is recognized that the horizontal justification rule 
could call for left justification and measuring horizontal 

10 displacement from the left margin, as well as a zero descent 
angle, combing to result in left justified text on each line. 

It is also recognized that horizontal text positioning 
can be accomplished in numerous equivalent ways to the above 
example. In particular, calculations of text position can 

15 be accomplished by first .justifying then shifting, or first 
shifting then justifying with equivalent results. 

Gap Length 

In ' one embodiment, gaps are associated with folding 
2 0 points whose locations have been determined, but because of 
other rules, remain on the same line and' do not cause 
folding. A gap of zero or more spaces is added after a 
folding point where that folding point has failed to cause 
new line creation. In a preferred embodiment, the gap length 
2 5 is a reader determined parameter, where a gap length of zero 
results in a no gaps being created. Gaps allow a visual cue 
as to the existence of phrases even where the phrases have 
not caused new line formation. 

■30 . Advancement Rates . 
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Advancement rates specify display duration times and the 
time intervals between the presentation of one grouping of 
text and the next. In a preferred embodiment, one sentence 
is presented on one screen. In a preferred embodiment, the 
5 display duration rate can be a function of the text's 
appropriately weighted number of words, educational level, 
pronunciation time, number of phrases, number of syllables, 
or phrase weight. Time intervals can include the interval 
between sentences and paragraphs. In a preferred embodiment, 
10 the time interval between sentences and paragraphs is 
different. In this way, the constant arrival rate of text 
in current systems can be replaced with a rate dependent on 
where the text lies and what the content of the text is. 



15 Stations 

Stations are display surface locations at which text is 
displayed. Stations may be identified windows within which 
text is presented or points at which text presentation 
begins. A preferred embodiment includes an active text 

20 station, where text being read is presented. Another 
preferred embodiment includes a pre-reading station 
displaying about to be read text and a post-reading station 
displaying already read text. In one embodiment, the total 
text presented at all stations on the viewing surface is 

25 controlled by the expected reading or pronunciation time. 
In one embodiment, only about one minute of material is 
allowed on the screen at any one time. 

Animation 

30 Animation is the time dependent presentation of text. 

Examples of animation include blinking, dissolving, and 
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swiping, that is, the- brightening of successive text portions 
at a specified rate. • In a preferred embodiment, a modified 
scroll effect is accomplished by stacking about to be read 
text in flat, rows at a pre-reading station at the top of the 
5 screen, stacking previously read rows at a post -reading 
station at the bottom of the screen, and cascading the active 
sentence at an active station across the middle of the 
screen. In one embodiment, pre-reading and post reading text 
and/or background colors- differ from that of the ■ currently 
10 being read text . 

Tagging 

Tagging includes designating whether a sentence will be 
tagged with a definition or a drawing related to the word. 

15 In a preferred embodiment, a word set specifies which words 
will be tagged with a definition. When a tagged word is 
selected by a reader, a definition, drawing or other 
electronic illustration of the word can be displayed. In a 
preferred embodiment, a tagged word, when selected, displays 

20 a pop-up window containing the definition or drawing. 
Preferred methods of selection include using a mouse and 
right shift button. 

Reading Event 

A reading event includes the appearance and 
25 disappearance of a sentence and any additional time before 
the appearance of the next sentence. A reading . event 
contains a series of reading moments.. A reading moment is 
a freeze frame appearance of text to the eyes of the reader 
trying to comprehend the text. To many readers, the reading 
3 0 moment will find the eye centered on a phrase, the phrase 
alone on a line, the- reader, comprehending the single phrase. 
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Reading Rate 

The presentation interval is the duration of a sentence 
presentation on the screen. The presentation interval may 
be reader controlled or automatically determined. Reader 
5 control in one embodiment may be via mouse clicks. In 
another embodiment, reader control may be via eye movement 
detection or brain wave change detection. Brain wave 
detection operates by generating a new sentence request when 
the brain waves corresponding to reading activity change to 
10 brain waves associated with having finished reading the 
sentence . 

Reading rate is measured in text content per unit of 
time. Such Text Content Units may be measured in length 
units such as number of words, syllables, pronunciation time, 

15 or any. of previously discussed measures of phrase length or 
weight or any sum of products of these. Text Content Units 
may also be measured in complexity units such as those 
previously discussed with respect to phrase complexity or 
weight or any sum of products of these. The Text Content 

20 Units in a preferred embodiment are calculated for a 
presented sentence and used to compare the actual reading 
rate in Text Content Units per time with reader controlled 
presentation intervals, and to set the text presentation 
interval for automatically controlled text presentation 

25 intervals. In this way, the presentation interval can be 
made content dependent, and be made to track the likely 
reader preferred presentation rate. 

Special Events 

30 Special events are time dependent events that occur 

during the reading event. Special events include a visual 
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or audible cue giving a time remaining signal. For example, 
when 75% of the content dependent presentation interval has 
elapsed, a visual cue would appear on the screen. Special 
events may be arranged. by a special event script. Complex 
5 special events include a series of special events. 

Visual- Pronunciation 
Visual pronunciation involves staggering in time the 
color or brightness changes of individual phrases, words, and 
10 syllables, though not necessarily all of these. One 
embodiment denotes emphasis on longer, more difficult words 
-requiring longer to pronounce by using highlighting. Visual 
pronunciation is an example of a complex special event. 

15 Pulling Down the Cascade 

In one embodiment, text is displayed at a pre-reading 
station for a percentage of the content dependent 
presentation interval, then presented in a sentence .cascade 
one text segment or one line at a time. . Pulling down the 

20 cascade is an example of a complex special event. 

Non-Linear Text 
Linear text is text presented and read from beginning 
to end. A book designed to be read from beginning to end is 

25. a common example of linear text. Non-linear text includes 
the presentation and reading of text in an order other than 
linear. One example of non- linear text is Hypertext, where 
certain words are presented in such a way to indicate linkage 
e.g. the text is angle bracketed or colored blue.. Non-linear 

3 0 text presentation can be both reader directed. and automatic. 
One example of this. is automatic presentation of Hypertext 
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in* a depth first order, following the first Hypertext link, 
ignoring cycles. Another example is a breadth first 
presentation, presenting the first level of text, followed 
by any Hypertext links from the main level, followed by any 
5 Hypertext links from the first level, continuing until the 
lowest depth is reached or the reader intervenes. Yet 
another example is pruning either depth or breadth first 
presentation to include only portions having certain keywords 
of interest. 

10 

Magic Reading Glass 
In one embodiment, text presentation may begin by 
presenting common, unformatted text. When the reader desires 
to see text presented as enhanced text, the reader designates 

15 a portion of text for enhancement by placing an icon such as 
a "magic reading glass icon" over some part of the sentence. 
That sentence and following sentences are presented as 
enhanced text. This enhanced text presentation continues 
until the reader deactivates the magic reading glass. This 

2 0 magic reading glass can serve as an alternate point of entry 
into the enhanced text processor. 

Method 

In FIG. 1, step 110, the text is preprocessed . Step 110 

2 5 is shown in detail in FIG. 5. The text is parsed to identify 

paragraphs, sentences, words, and punctuation. Paragraphs 
may be identified by blank lines, paragraph markers, 
indentation characters, tab characters, or any other suitable 
characteristic in the text. Sentences may be identified 

3 0 using grammar rules including periods, spacing, 

capitalization of first words, and abbreviations or the lack 
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tnereor . In a preferred embodiment reading well behaved 
text, a period, question mark, or exclamation point, either 
alone or followed by a period, followed by two spaces or end 
of paragraph, signals the end of a sentence. 
5 In step 124, the sentence is tokenized into words and 

punctuation.- Original author specified emphasis, e.g. 
italics or underlining, is . preserved in preferred 
embodiments . A standard lexical scanner such as Lex 
(TRADEMARK) is used in one embodiment, where the end of a 

10 word is denoted- in the grammar rules by white space or 
punctuation. Another embodiment utilizes a hand written 
lexical analyzer. One embodiment stores formatting 

characters such as tabs and indents as punctuation. The 
location of a word is preferably stored, as an attribute of 

15 the word, to provide links to, and searching within, the 
original work. 

A preferred embodiment also allows groups of words to 
be "clamped" together, and be recognized as a group of words. 
In one embodiment, such groups of words are recognized by 

2 0 the lexical scanner. In another embodiment, such words are 

recognized by a preprocessor preceding the lexical scanner 
to insure recognition as a phrase rather than as * merely 
individual words. Clamped words, for example, "Prince of 
Whales", would be recognized as . a single phrase, and 
25 preferably not broken by the preposition into two phrases 
displayed on two lines. 

In step 126, the words are looked up in dictionaries, 
glossaries and tables to determine word attributes. The text 
is further processed to determine categorical and continuous 

3 0 attributes. In a preferred embodiment, important categorical 

attributes include parts of speech, and important continuous 
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attributes include word location, education level, 
pronunciation time, and syllable number, location, sound, and 
vocal emphasis level. Identifying parts of speech with 100% 
accuracy would require extensive programming to determine the 
5 real -world context of the text. Such accuracy is not 
required to practice the invention, as errors are of minor 
consequence because the reader is a human, not a machine. 
The possible parts of speech are first determined by looking 
up the word in a dictionary or glossary. This dictionary or 

10 glossary need only have the likely parts of speech for a 
word, not a definition. For example, the word "farm" could 
be a noun, verb or adjective. A preferred embodiment stores 
the parts of speech attribute using a bitmap to preserve the 
multiple possible parts of speech. One embodiment explicitly 

15 stores an ambiguity attribute, indicating whether the word 
still has multiple possible parts of speech. Another 
embodiment uses the existence of more than a single possible 
part of speech as an ambiguity indication. 

In a preferred embodiment, default parts of speech exist 

2 0 in a dictionary and may be looked up. In a most preferred 

embodiment, a word set may be added to override or supplement 
the default set. In another embodiment, technical words are 
specified by user entered word sets. 

FIG. 6 illustrates nine word sets specifying parts of 
25 speech arranged in a hierarchy. Such word sets and 
hierarchies are also used as input to folding rules, 
described later. A preferred embodiment checks the word sets 
illustrated in FIG. 6, beginning with Class 1, Subclass 1, 
and ending with Class 3, Subclass 1. Search is terminated 

3 0 once a word or phrase is found. Given the limited vocabulary 

and static nature of the word sets in FIG. 6, a most 
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pre t erred embodiment utilizes, a. .-fast ,. hand written parser to 
search for the words and phrases in FIG. 6. Preferred 
embodiments include parsers written in C, C++, Perl, compiled 
AWK, AWK and AWK to C, C with regular expression functions, 
5 or any suitable language. One parser embodiment utilizes 
YACC . 

In one embodiment, the dictionary is a commercially 
available dictionary on electronic media such CD-ROM. The 
standard dictionary is parsed' for word attributes such as 

10 parts of speech and number of syllables. As word definitions 
are not needed in many embodiments, storage of numerous words 
with associated number of syllables and parts of speech is 
possible. In a most preferred embodiment, the most commonly 
used and most recently used words are stored in fast access 

15 memory such a solid state Random Access Memory (RAM) . In 
embodiments where dictionaries are to be hand crafted, a fast 
method utilizing hashing, collision detection and buckets is 
preferred. In embodiments where the word sets are fixed 
before reading, perfect hashing without buckets is preferred. 

2 0 In yet another embodiment, the level of pronunciation 

emphasis is derived as an attribute depending in part on the 
part of speech. In a most preferred embodiment, 

pronunciation emphasis is categorized as primary, secondary, 
and none. In one embodiment, the pronunciation time and 

25 actual, sound, e.g. as found in a sound file, are also 
retrieved from the. dictionary or glossary and ' stored as 
attributes of the word. 

In step 128, reader and text specific word sets are 
searched. In a preferred embodiment, the reader specified 

30 word sets .are stored in a - separate database from the 
dictionary or glossary word sets, to allow for separate 
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storage and faster retrieval. In one embodiment , reader 
specified word sets are checked before dictionaries, and the 
dictionaries only checked if needed words and attributes are 
not found in the reader specified word sets. Preferred 
5 embodiments utilize a hierarchy of databases to look up 
words . 

In step 130, multiple parts of speech are disambiguated. 
In one embodiment, a microgrammar is used to determine the 
likely parts of speech. A microgrammar utilizes adjacent or 

10 nearby words to more accurately determine the most likely 
part of speech for a word. For example, the word "farm" in 
the phrase "a farm in " would likely be a noun as it is 
preceded by an article and succeeded by a preposition. As 
another example, if a word could be either a noun or verb, 

15 and the word is preceded by "could", "will" , "shall", or 
"to", then the word is likely a verb. If the word "farm" 
were preceded by "will", the word is likely a verb. In 
another embodiment, all disambiguation is done simply by 
choosing the statistically most likely use of the word. In 

2 0 yet another embodiment, there is no automatic disambiguation, 
only manual disambiguation using human editing. In a 
preferred embodiment, an attribute of ambiguity is stored for 
each word, indicating whether multiple possible parts of 
speech still exist after disambiguation. In yet another 

25 embodiment, an ambiguity attribute is not stored but derived 
from the existence of multiple possible parts of speech 
stored for a word. In one embodiment, ambiguity is inferred 
from the visual display of striped or alternating text colors 
associated with each part of speech. For example, if verbs 

30 are orange and adjectives are yellow, then a possible verb 
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or " adjective could have alternating- yellow and orange stripes 
or text characters. 

In one embodiment of the invention, parts of speech are 
determined . in part by searching for morphemes (root words) 
5 and assigning part of speech attributes based on endings e.g. 
-ly, -ing. 

. In step 132, the attributes determined for the words and 
phrases are stored, creating an "enriched sentence", which 
will likely remain unchanged between readers. For example, 

10 the educational level and part of speech of a word will 
remain unchanged for different readers, even though they may 
desire different text segment lengths and presentations 
rates. In one embodiment, the enriched sentence is stored 
in persistent storage such as a file. In another embodiment, 

15 the enriched text is stored on CD-ROM. In a preferred 
embodiment, the enriched sentence is implemented as a linked 
list of nodes, each node, having the word and phrase 
attributes described above including the position of the word 
in the original text . 

20 In FIG. 5, step 134, primary folding points are 

determined by applying primary folding point rules. Folding 
points are text dividing points located between letters. In 
a- preferred embodiment, folding points are classified as 
primary and secondary . Primary folding points are determined 

2.5 using primary folding rules which determine primary folding 
point locations based on punctuation marks. .FIG. 7 
illustrates a primary folding point after the comma following 
"Africa". .Primary folding points divide text into "Super- 
phrases"., In a preferred embodiment, primary folding points 

30 are located at every, comma, colon, semi-colon, and left 
parenthesis, brace, and curly bracket. The folding point 
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location can be stored as an attribute in a node in a linked 
list of nodes forming the enriched sentence. 

Secondary folding points are determined applying 
secondary folding point rules. In preferred embodiments, 
5 secondary folding points and rules are ranked in a hierarchy 
and secondary folding rules accept parts of speech as inputs. 
In a most preferred embodiment, secondary folding rules 
include as rule inputs attributes of the text content of the 
text segments and phrases being processed. For example, a 
10 secondary folding point may be called for by a segment of 
text exceeding a reader preferred maximum text segment weight 
even though a maximum text segment length has not been 
reached . 

Continuous attributes such as phrase difficulty, 

15 density, complexity, power and pronunciation time may be used 
as inputs to a rule modifying the ranking established by a 
table such as that of FIG. 6, using parts of speech alone to 
determine secondary folding part rankings. For example, a 
segment of text having a weight greater than 3 5 percent above 

2 0 the text average would have a Class rank of 1 assigned 
regardless of the rank otherwise called for by the table of 
FIG. 6. In one preferred embodiment, phrase weight or power 
is used exclusively to determine secondary folding point 
rankings, rather than solely parts of speech. 

25 In an alternate embodiment, folding rules call for 

folding based on the number of characters on the line, and 
the parts of speech are displayed using colors corresponding 
to a word's part of speech. The later embodiment may not 
offer the advantages of cascading, but does offer visual 

30 display cues based on text content. 
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FIG. 6 illustrates.- a. table . used . in a" preferred 
embodiment to determine secondary folding points. For 
example, prepositions determine Class 3, Subclass 1, 
secondary folding . points . In FIG. 7, there are class 3 
.5 secondary folding points before, the . prepositions "in" and 
"of". Secondary folding points divide Super-phrases into 
"Mini -phrases " , as illustrated in FIG. 7. Mini-phrases are 
•related to text segments in that Mini-phrases are often the 
same as text segments and are often displayed each on a new 
.10 line. . Once Mini-phrases are identified however, rules may 
dictate that more or less than- one Mini -phrase appear as a 
text segment on a line. 

Primary folding rules are applied first, followed by 
secondary folding rules, applied in order of the folding rule 

15 rank. An example of secondary folding rule ranking is shown 
in FIG. 6, established by the ranking of the word sets giving 
rise to the secondary . folding points. . Some preferred 
embodiments use either phrase weight or power to determine 
secondary folding point rank rather than solely using parts 

2 0 of speech. A most preferred embodiment allows reader entry 
of a preference for parts of speech or phrase weight /power 
determination of secondary folding point ranking. . Some 
readers . prefer text segmentation based on structure, while 
others prefer text segmentation based on complexity or 

25 estimated time to read a text segment. 

In a preferred embodiment, secondary folding rules are" 
applied only until a limit, is reached. This limit is often 
the minimum line length. ■ One method of- determining the 
location of secondary folding points is shown in. FIG; 5, step 

30 136, and in, detail- in FIG. 8, step 136. In one. embodiment, 
where the application of a secondary folding rule to a Super- 
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phrase would result in a Mini -phrase length less than the 
minimum specified line length, the folding rule is not 
applied and no further folding rules are applied to that 
Super-phrase. Conversely, when no folding point would 
5 otherwise exist in a line exceeding the maximum line length, 
a collapse rule is applied, forcing the folding of the text 
into two lines. When all Super-phrases are to have no 
further folding rules applied, the folding process is 
complete . 

10 In FIG. 1, step 111, the parameters, attributes, and 

folding rules can be used as input to the horizontal 
displacement rules. The horizontal displacement rules 
determine the horizontal location of the text segment. In 
a preferred embodiment, horizontal displacement rules include 

15 both horizontal justification rules and descent angle rules. 
Horizontal displacement in this embodiment is the sum of the 
results from the horizontal justification rule and the 
descent angle rule. In an easy to implement embodiment, the 
horizontal displacement rule is simply the descent angle as 

20 applied to the center justified text segment. Such... an 
embodiment does not utilize the folding rule terminating the 
preceding text segment as input and provides minimum eye 
movement while reading the sentence cascade. Another 
embodiment adds left descent for preceding Class 1 folding 

25 points, and right descent for preceding Class 3 folding 
points. A preferred embodiment allows reader specified 
additional right or left displacement for folding points, 
including reader entered values for primary folding points, 
and each class and subclass of secondary folding points. One 

3 0 embodiment stores the added displacement in a table in units 
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ot characters. With the horizontal displacement determined, 
presenting the text remains. 

In the example of FIG. 9, Super-phrase 1, "I had a farm 
in Africa" is divided from Super-phrase 2, "at the foot of 
5 the Ngong Hills.", by' the primary folding point after the 
comma. Super-phrase 2 is divided into two Mini -phrases by 
the secondary folding point before the preposition "of" . In 
the embodiment illustrated in FIG. 9, two miniphrases are 
presented as the same text segment as the mini -phrase" "in 

10 Africa" , is below the three word minimum length specified by. 
the reader. The first Mini -phrase, "at the' foot", in a new 
line is center justified below the text- segment above and . 
right shifted by a right descent angle. The last Mini-phrase 
of "of the Ngong Hills", is left shifted because of a 

15 horizontal displacement rule calling for left shifting when 
the preceding line terminated with a secondary rather than 
primary folding point. " Thus, in the FIG. 9 example, the 
total horizontal displacement is determined by a combination 
of the decent angle and the justification of the line. 

2 0 , Paired punctuation marks including parentheses, braces, 
brackets, and quotation marks, serve as punctuation marks 
which determine primary folding point locations in a 
preferred embodiment. In one embodiment, such paired 
punctuation is included as- an input to the horizontal 

25 displacement rules, .including - horizontal justification and 
descent angle rules. For example, a long multi-phrase text 
.segment contained . within, parentheses might have reduced 
horizontal -shifts and reduced vertical displacement, i.e., 
less, line to line spacing than the other text . in the- active 

30 display-area of the display surface. * 
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m step 112, the enhanced text is created. In this 
step, the codes needed to create a properly displayed text 
segment are created. For example, where the reader 

specifications require coloring technical words red, and the 
5 enriched text indicates a word is a technical word, an escape 
sequence may be created that will be interpreted by the 
display step as requiring red text. Similar coding may be 
required for animation. The enhanced text may be stored at 
this point for later display. 

10 In step 113, the enhanced text is presented on the 

display device, one text segment per newly formed line. The 
enhanced text can also include the animation, background 
color, text color, tagging, and presentation rates discussed 
above. In a preferred embodiment, the background color is 

15 presented as a function of the sentence and paragraph 
positions . 

In another embodiment, illustrated in FIG. 11, some text 
is initially presented in one color or brightness for a time 
period, followed by presentation in a second color . or 

20 brightness. In FIG. 11, the sentence is presented on three 
newly formed lines indicated by arrows 200, 202, and 203. 
Within those lines, the text is presented all on the same 
line, with the words of FIG. 11 shown on different lines to 
illustrate the temporal change of initial text 

25 color/highlight 206 to text color/highlight 207, and initial 
text color/highlight 208 to 209. The "Af" text at 206 is the 
emphasized syllable in "Africa", and is initially shown in 
color/highlight 206 for this reason. The "gong" text is also 
the emphasized syllable in "Ngong" , and has initial 

30 color/highlight 208, followed by color/highlight 209. 
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The preferred embodiment depicted in FIG. 1 allows the 
enriched text from step 132 and enhanced text from step 113. 
to be edited. In a preferred embodiment, a word pointing 
device such as a mouse is used to select a portion of text 
5 to be edited. The enriched sentence corresponding to that 
portion of enhanced text is internally selected, and the 
attributes made available for editing. This may be 
implemented using pull -down menus allowing each attribute of 
the enriched text and enhanced text to be edited. Where 

10 edits to the enriched text could effect presentation, the 
text is preprocessed according to step 110 again. In the 
edit session of step 114, reader annotations, either ■ hidden 
or immediately visible, are accepted and can be stored in the 
enriched and enhanced sentences. Such annotations perform 

15. the same function as hand written notes in a book. The 
features editable include parts of speech, definition, color, 
text, folding points, and horizontal displacement. 

The edited attributes and display of this embodiment may 
also be stored, in step 116, preserving the changes. In one 

20 embodiment, only the enhanced sentences are stored. In a 
preferred embodiment, both the enriched and enhanced text are 
stored. In preferred embodiments, some edits are recorded 
either as reader specific or global, for presentation to all 
readers of the text. Manual editing of the enhanced text is 

25 especially useful where the same text will be viewed 
repeatedly by others, as with an electronic book. 

•In a variation of the embodiment of FIG. 1, steps 113, 
114, and 116 are omitted, with no human intervention and no 
immediate display. In this embodiment, enriched and enhanced 

3 0 text is created and stored for future display. The enhanced 
. text can be stored in standard word processing format such 
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as" Microsoft Word (TRADEMARK) or Corel Word Perfect 
(TRADEMARK) binaries. In this embodiment, the presentation 
software can be simple, small, and fast relative to the 
software required to look up words and analyze text. Such 
5 a presentation is a preferred embodiment for the mass 
distribution of enhanced text for reading as "electronic 
books " 

In a related variation of the embodiment of FIG. 1, 
enhanced text itself is retrieved in step 106, with no 
10 preprocessing required and no edits allowed. Such a 
presentation is also a preferred embodiment for the mass 
distribution of enhanced text for reading as "electronic 
books " . 

Referring to FIG. 1, step 113, the presentation of each 

15 screen of enhanced text may be manually triggered as by;, a 
mouse click. In a preferred embodiment, the rate of 
presentation is controlled by reader specified parameters 
including display time for the text, and inter-sentence and 
inter-paragraph arrival times. In a most preferred 

20 embodiment, the Text Content is measured, and the text 
presentation interval is dependent on this Text Content. In 
a preferred embodiment, the pronunciation time of the text 
is used as a measure of Text Content to determine 
presentation interval. In another embodiment, the phrase 

2 5 weights are used to measure Text Content and to determine 
presentation interval. 

A preferred embodiment allows readers to .extend the 
presentation time for a sentence, as well as speed up and 
slow down the presentation rate. This rate can be recorded, 

30 as can the sentence length and sentence difficulty 
corresponding to a particular presentation interval. FIG. 
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10* illustrates an example 3-D. plot, a "Presentation Interval 
Sampling History Map", depicting the time needed to read a 
sentence as a function of two attributes, sentence difficulty 
and sentence length. The time needed to read can be measured 
5 by reader preferences or by previously mentioned eye movement 
tracking or brain wave activity. The. time can then be 
correlated against two attributes as in FIG. 10, or any 
number of attributes. The presentation interval in a 
preferred embodiment is continuously adjusted to match the 

10 predicted required reading time. 

In yet another embodiment, most appropriate where 
reading rate is closely measured, the inputs to folding rules 
are varied and " the resulting reading rate tracked. In an 
embodiment suitable for creating an optimal mass market 

15 reading product, inputs to folding rules are varied and 
reading rates recorded for a sample population. The inputs 
are varied, for optimal reading speed and comprehension. For 
example, the importance accorded by secondary folding rules 
to parts of speech relative to phrase weight is varied for 

2 0 optimal reading speed. 

In another embodiment, reader manual editing of initial 
sentence display is analyzed for relative contribution of 
sentence structure, parts of speech, length, and complexity. 
After such an initial "tuning" or "training" period, similar 

25 weightings are used in folding rules for automatic text 
enhancement. Subsequent edits may be used to further refine 
the folding rules ... 

In step 118, text presentation stops -when there is no 
more text or a reader request to stop. Steps 120 provides 

30 for clean-up including final enriched and enhanced text 
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storage, as well as historical storage about the reading 
session . 

EXAMPLE OF METHOD 
Overview of Example Method 
5 The present invention includes a method for text folding 

and displacement that applicant believes is an improvement 
over the method previously described under the heading 
"method" above. 

One embodiment of the present invention classifies 
10 punctuation marks as either "serial" or "bracketing." Serial 
punctuation marks include colon, semi-colon, comma, a single 
double dash ("--") , and the ellipse. Bracketing or nesting 
punctuation marks include quotation marks, parenthetical 
marks, brackets (as in [ and ]), and a pair of double dashes. 
15 The present invention works best when bracketed segments do 
not start inside of one bracketed segment and end within 
another. This is normally the case. 

Segments within bracketing punctuation marks can be 
serially divided with serial punctuation marks, be further 
20 bracketed with inner bracketing punctuation marks, or both. 
There is one case where two commas in a segment produce a 
kind of bracketing: the middle segment of the three new 
segments formed is "bracketed" by the other two segments. 
This is common and can distinguish a relative clause from a 
25 non-restrictive one. It is also the way "for instance" and 
other such phrases are imbedded in larger phrases . Some 
bracketed text e.g. text within quotation marks, can span 
more than one sentence. 

In the method described below, bracketed segments are 
30 identified. The text outside of the bracketed segment is 
examined for serial punctuation marks. These are used for 
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folding first. Then non-bracketed text and bracketed text 
are separated with folding steps, that put each type of text 
on separate rows . Bracketed text is placed on its own row, 
with the bracketing punctuation marks at the very beginning 
5 and end of each segment. This cycle is repeated as needed. 
A segment is ready to leave the algorithm portion dealing 
with "punctuation mark folding" and begin with "word-only 
folding" (word based folding) , when it contains no 
punctuation marks other than those' found at the beginning and 

10 end. Steps 1 through 15 in the algorithm below deal with 
punctuation mark folding. 

Word-only folding begins with step 16 and will fold each 
segment to fit between maximum and minimum targets . Folding 
points in the text will be specified by "hinge words." The 

15 hinge words can be specified by a word list. ' In a preferred 
embodiment, words or phrases in the word list are associated 
with a classification code or code word that includes 
information about the word. In the example illustrated 
below, the classification include a letter prefix and a 

20 number rank or level number. Letter prefixes include "b" 
(fold before this word, not after) , "a" (reserved, for future 
use, fold after this word), "x" (definitive : subjective 
pronoun list), "y" (pre -determiner list), "z" (post- 
determiner list) . Examples of words and associated codes are 

2 5 contained in Appendix 1. 

In the example below,, the level numbers range from 0 to 
99. The lower level numbers have higher rank and are handled, 
first by the algorithm. The variable "n" is used to denote 
this value in the steps described below. The 10 - 3 9-* range 

30 includes the before "b" hinge words. The 40 - 46 range 
includes verbs, including 40 (modal), 41 (have, auxiliary 
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verbs), 42 ("to be" verbs), 43 (unambiguously transitive 
verbs) , 44 (unambiguously intransitive verbs) , 45 (ambiguous 
transitive verbs, words not always verbs), and 46 (ambiguous 
intransitive verbs, words not always verbs) . 
5 Letter prefixes relating to verbs include "c" 

(infinitive), "d" (past participle), "e" (other forms that 
do not take helping verbs) , "f " (can be both infinitive and 
past participle) , and "g" (gerund) . The verb classification 
is used in an improved verb handling method described in 

10 another section. 

"Lane" refers to a unit of horizontal displacement that 
is subdivided into a sub-unit of horizontal displacement 
called a "Slot." In a preferred embodiment, each lane is 4 
spaces wide, subdivided into 4 slots each 1 space across. 

15 The lanes are numbered 1 through 5 and the slots labelled A, 
B, C, and D. In a preferred embodiment, Lane 1, slot A, 
begins 2 spaces from the left margin, followed by slot B, 
then C, then D, followed by lane 2, slot A, etc. 

"X" (upper case X) denotes the generation number i.e. 

2 0 the recursion level in the algorithm. For example a sentence 
is divided into a segment 1 and a segment 2, segment 2 is 
further divided into segments 2.1 and 2.2, and segment 2.1 
is further divided into segments 2.1.1 and 2.1.2. Segments 
2.1.1 and 2.1.1 are at generation 3. X is often used to 

25 determine the coarse horizontal displacement i.e. the lane 
number. 

The "x" (lower case x) denotes the index or offset into 
the sentence or sentence fragment at a particular word. The 
x is incremented/decremented in words, not characters. 
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The "n" term refers to the hinge word level number. In 
the example below, the hinge word level ranges from 1 through 
99. 

Referring now to FIG. 12, a table 320 includes a header 

. 5 row 322 listing the spaces from left margin for each column 
below. A header column 324 contains a list of hinge word 
levels. The rows are divided into a series of lanes 328 
which are subdivided into 4 slots each, A series of Xs, for 
example, at 330, denote . the location of the start of a text 
10 segment, given the hinge word level and lane. 

The Xs in the tables shows the slot and lane into which 
a segment ' s ■ first character will be placed as a function of 
the -hinge .word used to make the fold that produced the 
segment. Each hinge word level, e.g., blO, b20, can be 
15 placed in any of the Lanes from Lane 2 on up. The lane used 
is determined by which generation of the sentence folding did 
the fold for the segment occur in. Then, within that lane 
(e.g., lane 3 for a third-generation fold), a slot is 
determined by the hinge-word level, as shown in the table. 

.20 In this way, a third-generation fold made with a b20 level 
word will be placed in Lane 3 slot B, and a third-generation 
fold made with a b70 word will be placed in Lane 3 slot D. 

The levels, shown . in the table at level b85-will have 
folding occur BOTH before AND after the word- -in effect 

.25 placing the word by itself on a its own line. The 
instructions on the table state where the b85 word should be 
placed, and. where the segment following the b85 word should 
be placed. The criteria for a b85.word is. not on "the Hinge 
Word list, but instead has been defined as any word exceeding 

30 12 characters. 1 As its position on the Hinge Word table 
implies, b85 words are only used for folding if there are no 
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alternatives higher on the list in the segment being 
interrogated for folding. It is otherwise not explicitly 
described in the algorithm. 

5 Method 

The Recursive algorithm is begun by setting X=l . Thus 
initially, the first lane will be used and the algorithm 
generation is 1. 

10 Punctuation Folds 

1. Other than punctuation marks (pms) that may be present at 
the very beginning or very end of a sentence/ segment , are 
there any other pm 1 s in the sentence/segment ? Yes-go to step 

2. No-go to step 16. 

15 

2. Are there bracketing punctuation marks in the 
sentence/segment? Yes-go to step 3. No-go to step 4. 

3. Are there serial punctuation marks "outside of" the 
20 bracketed text in this sentence/segment? (* If a sentence 

begins without a quotation mark, but has the second member 
of a pair of quotation marks later in the sentence [i.e., the 
quotation started in a previous sentence and is ending in 
this one] , then the segment from the beginning of the 
2 5 sentence to the space following the second member of the pair 
is also a "bracketed" segment; a similar rule applies if a 
sentence contains the first but not the second of quotation 
mark pair.) Yes-go to step 4. No-go to step 9. 

30 4. Are there colon/ semi -colons in the non-bracketed text from 
step 3? Yes-go to step 5. No-go to step 6. 
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5. Fold the sentence/segment after "each colon/semi -colon and 
Pi 

ace the text that follows each colon/ semi -colon (which may 
contain bracketed text) onto a new row and indent each new 
5. row at position Lane X, Slot A; then go to step 6. 

6. Are there commas in the non-bracketed text? Yes-go to 
step 7. No-go to step 8. 

10 7. Fold the sentence/segment after each comma and place the 
text that follows each comma (which may contain bracketed 
text) onto a new row; indent the new row of text that comes 
■after the first comma at Lane X, Slot D; indent the new row 
of text that comes after the second comma at Lane X, Slot B: 

15 indent any additional rows of text that follow odd-numbered 
commas at Lane X, .slot D; indent any additional rows* of text 
that follow even-numbered commas at Lane. X, Slot B. . Then go 
to step 15. * ■ 

2 0 8. Are there any single "double dash" (--), or ellipse (. . 

.) punctuation marks in the non-bracketed text? Yes-then 
fold, the sentence/segment immediately before each single 
"double dash" or ellipse: place each new segment- that 
contains the single "double dash" or ellipse and the text 
25 distal to it (which may also contain bracketed text) onto a 
new row; indent each new row at Lane X, slot C. Then go to 
step 15. 

9.- Is there any text between the very beginning of the 

3 0 sentence/segment (which itself may be a . bracketing 

punctuation mark) and the first " intra- sentence/ segment "* 
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oracKenxng punctuation mark? Yes-go to step 10. No-then keep 
the first bracketing punctuation mark at the same position 
(do not fold or indent at this bracketing punctuation mark; 
for example a parenthetical mark could lead and conclude a 
5 sentence or segment but be followed immediately by a 
quotation mark-these would then be left together according 
to this step) ; and go to step 11. 

10. Fold the sentence/segment immediately before the first 
10 bracketing punctuation mark (which, per step 9, does have 

text proximal to it) ; place this first 

" intra- sentence/segment M bracketing punctuation mark and all 
of the text distal to it onto a new row; indent this new row 
at Lane X, Slot D. Then go to step 11. 

15 

11. Is there a matching bracketing punctuation mark in the 
sentence / segment , (i.e., the second member of the bracketing 
pair)? Yes-go to step 12. No-then the second member of this 
bracketing pair of punctuation marks is in a later sentence; 

20 go to step 15. 

12. Is there any text distal to the second member (as per 
step 11) of the bracketing pair of punctuation marks? 
Yes-then go to step 13. No-then the second member of the 

25 bracketing pair of punctuation marks is the end of this 
sentence/segment; go to step 15. 

13 . Fold the sentence/ segment immediately after this second 
member of the bracketing pair; indent the new row of text at 
30 position Lane X, Slot B; then go to step 14. 
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14". Is there another bracketing punctuation mark in the text 
distal to the second member of the previous bracketing pair? 
Yes-go back to step 10 and repeat steps 10-14 for this next 
bracketed segment distal to (not nested in) the previous one. 
No-go to step 15. 

15. Take each of the new segments formed in steps 1 through 
14, add 1 to X, and go back to step 1. Repeat folding and 
indenting instructions using Lane X + 1. Repeat steps 1 
through 15 until all segments have punctuation marks located 
only at the beginning, or end, or both. of each segment. In 
this way all segments are eventually sent to step 16 for 
"word-only" folds. 

Word Only Folds 

16. Word-only folds begin with this step. For any value of 
X at step 1 where the answer is "no" and sends the segment 
to step 16, use the greater of: 2 or X for a Lane to begin 
the word-only folds. For example: If a sentence going 
through the cycle for the first time, (where X=l) , had no 
punctuation marks between its beginning and ending, and the 
answer to Step 1 was "no"; then begin word-only folds not 
with X (which . equals 1) but with 2 (which is. greater), i.e., 
in Lane 2. However, if two cycles through steps 1-15 were 
required to obtain a segment ready for word-only folds, then, 
at the beginning of the third cycle, where X now equals 3, 
and the answer to step one is "no", so at step 16 word-only 
folds begin with Lane X=3) . This will place word-only folds 
one lane to the right of the last lane used for punctuation 
mark folds. After determining which lane a sentence/ segment 1 s 
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nrst generation word-only fold will be made indents in, go 
to step 17. 

17. Does the sentence/segment exceed the Maximum Row Value 
5 (e.g., number of words or characters in the segment), or does 

it extend beyond the available space to the right? No- -stop. 
Yes--go to step 18. 

18. Are there words in the segment that can be found in the 
10 Hinge Word list at level [n] (e.g., level blO when n = 10)? 

No-go to 18 A. Yes-go to step 19. 

18A. Repeat the question for Hinge Word list level [n+1] 
(e.g., level b20, then b30, etc.); if there are no words in 
15 the segment that can be found at any level in the Hinge Word 
List, up to n = 95, then go to step 29. NB Words labelled 
99, with prefixes w, x, y, z are used in the verb loop, but 
are not directly used as hinge words for folding. 

20 19. Is there more than one word in the segment at Hinge Word 
level [n] ? Yes-use the first word that appears in the 
sequence of the segment, and go to step 20. No-go to step 
21 . 

25 20. Does the segment formed with the use of the word in step 
19 exceed the Minimum row value? No- -then repeat the 
question using the next word in the sequence of the segment 
that is in the same Hinge Word level [n] ; if none of the 
words at Hinge Level [n] produce a segment that exceeds the 

3 0 Minimum row value then go back to step 18 and repeat for 
[n+1] . Yes--go to step 21. 
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21". Fold the sentence at space designated by the word (before 
if prefix b, after if prefix a) or after) , and place the 
newly formed segment in one of the slots in Lane X, or Lane 
2, whichever is greater. The slot to be used in this lane 
5 will be determined by the Hinge Word level (see FIG. 12, 
described below) . Then go to step 22. 

22 . Does the segment exceed the Maximum Row Value or extend 
beyond the available space to the right? No- -stop. Yes--then 

10 go to step 23 . 

23. Are there are still levels to be checked on the Hinge 
Word List? Check up to n = 95 . Words in the word list 
having code words with n=99 e.g. w99, x99, y99, z99, are used 

15 in the verb loop described in a subsequent section but are 
not directly used as hinge words for folding. Yes -go to step 

24. No-go to step 29. 

24 . Are there words in the segment that can be found in the 
20 Hinge Word list at level [n] (e.g., level blO when n = 10)? 

No-then repeat the question for Hinge Word list. level [n+1] . 
If there are no words in the segment that can be found at any 
level in the Hinge Word List, then go to step 29. Yes-go to 
step 25. 

25 

25. Is there more than one word in the segment at Hinge Word 
level [n] ? Yes--use the first word that appears in the 
sequence of the segment, and go to step 26. No-go to step 27 

30 2.6. Does the segment formed with the use of the word in step 
2 5 exceed the Minimum row value? No- -then repeat the 
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question using the next word in the sequence of the segment 
that is in the same Hinge Word level [n] ; if none of the 
words at- Hinge Level [n] produce a segment that exceeds the 
Minimum row value then go back to step 24 and repeat for 
5 [n+1] . Yes--go to step 27. 

27. Fold the sentence at space designated by the word (before 
if prefix b, after if prefix a) , and place the newly formed 
segment in Lane X+l, or Lane 2 + 1, whichever is greater (i.e., 
10 one Lane to the right of the one used for indents in the 
previous word-only fold generation) . Does the segment formed 
exceed the Maximum Row Value or extend beyond the available 
space to the right? No- -stop. Yes--then go to step 28. 

15 28 . Are there are still levels to be checked on the Hinge 
Word List? Yes--go back to step 23, and perform any possible 
folds using Lane X+x, or Lane 2+x, indents from the table in 
FIG. 12. No-go to step 29. 

20 29. "Bend" the segment into two or more newly formed 
segments so that these newly formed segments are less than 
Maximum Row Value and the space available to the right, and 
place these newly formed segments in a center justified 
position beneath the first segment of the group. 

25 

Additional Folding for Verbs 
This section describes an additional process for text 
folding involving verbs in English. The added process fits 
into the previously described "Improved Folding" algorithm 
30 at step 18, as described below. The additional process is 
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not required*..-, to practice , the-i invention/ but provides 
additional folding processing for verbs as described below. 

It -is desirable for a text folding process to avoid 
breaking a string of related verbs that should remain on one 
5 segment; and 

to have folding occur at verbs when a discrete verb phrase 
is identified; as such, this does not require that a verb 
necessarily gets put on the beginning of a new row when 
identified, identification of an appropriate phrase boundary 

10 involving one or more verbs might result in anew row being 
formed after the verb (in English) . 

It is also desirable for a text folding process: to 
avoid separating the .word "to" from the infinitive form (and 
only the infinitive form) of a verb that follows it; to 

15 similarly link, if they precede a verb, the words "and" and 
"or" to verbs identified for folding (all verb forms, not 
just the infinitive forms) ; to process specific 
verb+preposition (or verb+adverb) combinations as a single 
word so that subsequent folding would avoid separating these 

2 0 prepositions or adverbs from the combination they belong to 
(e.g., "they broke_up the fight" v. "he walked up the hill"); 
and to similarly process the "not 11 forms of auxiliary verbs 
as a single word so that they may be recognized as a .single 
word at positions relative to other verbs (e.g. , "could_not 

25 go" should be processed in the same way as "could go") .It 
would also be desirable for the pronoun contractions of 
auxiliary verbs to be labeled as verbs, (e.g., "you'll"-, . 
"we've", "you* re") . 

Verbs are complex. ■ They can be auxiliary, modal, or 
.30 ordinary in function. They may be regular or irregular in 
conjugation. They may be transitive, intransitive, or either 
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in' their ability to take an. object. They may be ambiguous 
in whether they are really verbs and not other parts of 
speech. They can be combined with specific prepositions or 
adverbs to mean something different from the verb alone. 
5 They have several forms which may or not be combined with 
auxiliary verbs to create various tenses and which agree with 
the person and case of the subject. 

At the present time, it is not practical to direct 
cascade formatting using all of these variables in all their 

10 combinations. However, it is possible to classify verbs into 
four major function groups (modal, have, be, and ordinary); 
to sub-classify the ordinary verbs into unambiguous v. 
ambiguous and transitive v. strictly intransitive; and, for 
each of these groups, to identify up to five different forms 

15 (infinitive, past participle, gerund, other, and combined 
infinitive-past participle) . 

Definitions for Verb Folding Method 
The "x" (lower case x) denotes the index or offset into 
20 the sentence or sentence fragment at a particular word. The 
x is incremented/decremented in words, not characters. 

The "n" term refers, in the verb loop algorithm, to the 
word in text position relative to the word being 
investigated. The "n" variable does not refer to hinge word 
25 level as in the previous algorithm 

Introduction 

For each of these function-form verb categories there 
are basic operations that will determine if folding should 
30 occur at a verb, x, (that was otherwise identified for 
folding by MIN and MAX criteria) . These operations look at 
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the word immediately before (x-1-) the verb in question and 
determine if it belongs to a set of words specifically 
defined for that function-form group. Based on this, then 
the potential fold is either skipped, (and the next verb in 
5 the segment that is a candidate for folding at that hinge 
level is considered), or the potential fold is kept open to 
consideration pending the results of (x+1) operations. 

The content of these sets for the (x-1) operation will 
include: words that would disambiguate a verb-noun into a 

10 noun; and words that are appropriate helping verbs for the 
verb in question. 

In a subsequent operation, a potential fold before x 
will be deferred if x+1 is a. verb. The x+1 verb is examined 
to see if the word before it (namely x) is on its list;- if 

15 x is not on the list for x+1, then the fold is performed 
before x+1 rather than before x (because x+1 is a verb 
belonging to a separate verb phrase) . If x is on the list 
for the x+1 verb, (i.e., x is a helping verb for. x+1) , then 
folding is NOT performed at x+1, and the word after x+1, 

20 (i.e., x+2) , is examined. If the word after x+1 is not a 
verb, then the original deferred fold to occur before x is 
now performed. 

This process exploits the directionality of the. folding 
process: the existing . folding procedure moves the inquiry 

25 " of. each potential verb from first to last in the sentence 
sequence. If two verbs are adjacent to each other, then the 
x-1 operation performed for the second verb in the adjacent 
pair of verbs (an operation which looks at the first verb of 
the pair to see if it is- on a . list specific for the 

30 form-group of the second verb) will determine if a fold 
should occur between the first and second verbs. 
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An x-1 operation is required for each verb, even if it 
is the first word beyond the MINIMUM ROW VALUE. The reason 
for this is that it is possible the helping verbs of a verb, 
x, in question were passed over in previous potential folds 
5 because they fell within the MINIMUM ROW VALUE. However, by 
looking back toward the beginning of the segment, the x-1 
operation will detect whether a helping verb for x did indeed 
precede it (even though x-1 is within the MINIMUM ROW VALUE. 
In this case, the fold at x is not performed. 

10 Moreover, even if x is followed by another verb in this 

case (or any case where x-1 is a helping verb for x) , this 
verb following x (at the x+1 position) , will not be actively 
looked for once the (x-1) operation determines that x is 
preceded by a helping verb for x. Instead, the folding 

15 process-- which is still being driven by the fact that .the 
segment remains >MAXIMUM ROW VALUE (because the potential 
fold at x was not made)-- will go to the next available verb 
in the segment; the process will then find the verb that had 
just been x+1, and analyze it as a new x (called x* here) . 

20 The x*-l operation will now look back at the former x and 
determine whether x*-l is an appropriate helping verb for x* . 

The x-1 operation for level 40 verbs (modal verbs, see 
below) , and the x-1 and x+1 operations for level 45/46 verbs 
(ambiguous verbs that may be either transitive [45] or 

25 strictly intransitive [46] ) , are slightly different than 
those used for all of the other verbs. In the case of modal 
verbs, the algorithm was simplified because only an 
infinitive form of a modal verb (and there is only one modal 
verb that comes .in infinitive form, i.e., "do") can be 

30 preceded by another modal verb (e.g., "could do") . In the 
case of 45/46 level verbs, the typical x-1 operation is 
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initially performed but is followed by specialized x-1 and 
x+1 questions. These will attempt to disambiguate x, and 
will include verb-verb interfaces on either side of x. 

An inquiry about a potential fold at a verb x on a lower 
level (e.g., 40), might end up with a fold being made at the 
space preceding a higher level verb (e.g., 46) that follows 
it, if one or more verbs sequentially follow x. Once a fold 
has been made, then the >MAX question is asked again. If 
more folding is needed, then the- process looks again for 
lower level verbs first. This filters out the more 
elementary verb phrases first (e.g., those beginning with a 
modal verb, such as "I could • have bought- some milk"); 
followed by verbs tenses involving helping verbs (e.g\ , "We 
have been going there for several years"); followed by 
unambiguous verbs; then ambiguous verbs. Hopefully, the 
segments will be so frequently brought' down to <Max using the 
other verb levels, that the steps for ambiguous verbs will 
not be used very often,. By the. time level 45/46 verbs are 
used to initiate an inquiry for folding, the higher level 
verbs will have all been filtered out. This permits some 
useful assumptions involving verb-verb interfaces that occur 
between two different 45/46 verbs. 

• There are four reference lists that are used in- addition 
to verb-verb comparisons : a definite subjective pronoun list 
(which will make an immediately subsequent ambiguous verb a 
definite verb, denoted by x99 in the word list) ; a 
pre-determiner list (which will make a subsequent ambiguous 
verb a definite non-verb, denoted by y99 in the word list) ; 
a post -determiner list (which will make a preceding ambiguous 
verb an appropriate phrase boundary, denoted by z99 in the 
word list) / and a gerund helper verb' list (which would 
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prevent: rolding in front of the gerund verb form) , denoted 
by w99 in the word list. 

The above algorithms for Lane and Slot assignments of 
newly formed segments can still be used. The Lane, X, into 
5 which a newly formed segment is put is derived from the 
progressive folding history of a segments generational 
"ancestors". The Slot (a,b,c,d) within each Lane, into which 
a newly formed segment is placed, has, up to now been a 
function of the hinge word level of the word. Because all 

10 of these words in the VERB LOOP are by definition verbs, the 
Slot assignment would be the same, e.g., Slot b. 

However, to try to convey the differences among the verb 
loop folds, the Slot assignments could be modified. Any fold 
made in the space before the inquiry verb, x, could be in 

15 Slot c. Any fold made in the space before a subsequent verb 
after x (i.e., x+n) , when x was followed by one or more 
verbs, could be in slot b IF the verb at x+n was unambiguous 
(43 or 44) . Any other folds in spaces after x could be in 
slot d. 

20 

Process Overview 
A lexicon of verbs is built. While this can be done 
manually, the rules presented here make it possible to 
automate this with an electronic dictionary. Each verb is 
25 labeled according to its function and form. 

In the current hinge word list terminology, verbs would 
be at a "40s level". The four function groups will therefore 
be : 

modal=4 0; have verbs=41; be verbs=42; and ordinary 
30 verbs=43/44 and 45/46. Groups 43/44 are unambiguous verbs 
i.e. they are always verbs. Groups 4 5/46 are ambiguous verbs 



53 



WO 99/39255 



PCT/US99/02227 



i.e. they are not certain to be verbs. The odd number in 
each of these pairs represents transitive verbs; the even 
number represents strictly intransitive verbs . The verbs at 
either a 43 or 44 level will be looked for simultaneously in 
5 the search for a new candidate verb for folding; once a verb 
at either 43 or 44 is found, the x-1 operations are different 
for 43 versus 44. Similarly, the 45 and 46 level verbs will 
be initially looked for simultaneously, but handled 
differently once identified for potential folding. 

10 "Open" verbs, namely those not preceded by a verb, will 

be identified for potential folding as a function of the 
number of the function group, as is done for the other hinge 
words on the hinge word list. A string of sequential verbs 
(or potential verbs) could have several function word levels 

15 in it: "He should_not (40) have (41) been (42) bringing (43) 
work (43) home." The steps outlined later will allow the 
(x-1) then (x+1) operations to continue through the string 
independent of the hinge levels of the words in the string. 
A preferred method includes five different kinds of verb 

20 prefix classifications, based on the form of each verb. I 
have therefore called each of these five groups: c (for 
infinitive form, e.g., "to walk", but also "I walk", etc.); 
d (for past participle form, e.g., walked); e (for other 
forms that do not take any. helping verb, including: those 

25 modal verbs which have only this form, the third person 
singular form of regular verbs, e.g., "he walks", but also 
"he goes") ; f (for forms that are both infinitive and past 
Participle, as in some irregular verbs such as "to cut" and 
"have cut 11 ); and, g (for gerund form, e.g., walking). 
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Examples of how specific verbs would be labeled with 
this classification are included below. Further examples are 
contained in Appendix 1. 

Do c 40, Did e 40, Does e 40, Could e 40, 
5 Might e 4 0, Have c 41, Had d 41, Having g 41, 

Has e 41, Be c 42, Been d 42, Being g 42, Am e 42, 



Is e 42, Were e 42, 

Walk c 45, Walked d 45, Walking g 45, Walks e 45, 
10 Cut f 45, Cuts e 45, Done d 45, Doing g 45, 

Bring c 43, Brought d 45, Bringing g 45, Go . c 45, 
Gone d 45, Going g 46, Goes e 44, Went e 44. 



Integration with Example Method Above 
15 The following steps 18 and 18A replace step 18 and 18A 

in the above algorithm in embodiments using the verb loop 
algorithm: 

18. Are there words in the segment that can be found in 
20 the Hinge Word list at level [n] (blO through b39, and b50 
through b99)? No-go to 18 A. Yes-go to step 19. 

Step 18A. Repeat the question for Hinge Word list level 
[n+1] . IF there are no more hinge words at level b3 9, then 

2 5 before going to level b50, go to the verb loop for algorithms 
involving level 40-49. After completing the verb loop for 
level 4 0-49, then resume folding beginning with level b50 at 
step 18. If there are no words in the segment that can be 
found at any level in the Hinge Word List, then go to step 

30 29 . 
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Verb Loop * 

Ql. Are there any words in the segment labeled 40 through 46 
(with any letter c,d,e,f, or g before them)? 
No- -go back to step 18 in the usual algorithm. 
5 Yes- -go to step Q2 . 

Q2 . Is there a verb labeled 40 in the segment (or remaining 
segment) ? 

No--go to step Q20. 
10 Yes- -go to step Q3 . 

Q3 . For the first (or next) 40 level verb (x) in the segment, 
is x beyond the MINIMUM ROW VALUE (>MIN) ? 

No- -go back to step Q2 and inspect for the next 4 0 level verb 
15' in the segment distal to x. 
Yes- -go to Q4 . 

Q4 . Is the verb x a "c" form (i.e., is it labeled c40) ? 
No- -go to step Q6 . 
20 Yes- -go. to step Q5 . 

Q5 . Is the word preceding x, (x-1), a 40 level verb? 
No--go to step Q6 . 

Yes- -Then DO NOT fold at the space before x. Instead, go 
25 back to step Q2 and inspect for the next 4 0 level verb in the 
segment distal to x. 

Q6 . There will POSSIBLY be a fold at the space before x, but 
there may instead be a ■ fold before another verb at x+n. 
30 Check the word(s) following x, (x+n)", starting with n=l . Is 
x+n a verb (i.e., any word labeled 40, 41, 42, 43, 44, 45, 
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or" 46, with any of the following letters before the number: 
c, d, e, f, g)? 
No- -go to step Q6A. 
Yes--go to step Q7 . 

5 

Q6A. Is x a "c" form or an "f " form? 

No- -then fold at the space before x. If the word "and" or the 

word "or" is the word before x then do not fold before x. 

Instead, if the "and" word or the "or 11 word are greater than 
10 the Minimum Row value, (>MIN), then fold before the word 

"and" or the word "or" . If the word "and" or the word "or" 

preceding x is less than the Minimum Row Value (<MIN), then 

do not fold- - instead go back to step 2 and check for verbs 

in the segment distal to x. 
15 Place the new segment in LANE X (relative to the other prior 

generations of folding from the original segment / sentence ) , 

SLOT A. Then go to step Q19. 

Yes--then go to step Q6B. 

20 Q6B. Is x-1 the word "to"? 

No- -then fold at the space before x. If the word "and" or 
the word "or 11 is the word before x then do not fold before 
x. Instead, if the "and" word or the "or" word are greater 
than the Minimum Row value, (>MIN) , then fold before the word 

25 "and" or the word "or". If the word "and" or the word "or" 
preceding x is less than the Minimum Row Value (<MIN), then 
do not fold- - instead go back to step 2 and check for verbs 
in the segment distal to x. 

Place the new segment in LANE X (relative to the other prior 
30 generations of folding from the original segment /sentence) , 
SLOT C. Then go to step Q19. 
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*es--tnen fold at the space before "to". If the word 
immediately before "to", is "and" or "or", then fold before 
"and" or "or" instead of before "to". If the "and" word or 
the "or" word and the. word, "to" are all greater than the 
5 Minimum Row value, (>MIN) , then fold before the word "and 11 
or the word "or" or the word "to" , whichever is first. If 
the word "and" ■ or the word "or" or the word "to" preceding 
x is less than the Minimum Row Value (<MIN) , then do not 
fold- -instead go back to step 2 and check for verbs in the 
10 segment distal to x. 

Place the new segment in LANE X (relative to the other prior 
generations of folding from the original segment/ sentence) , 
SLOT C. Then go to step Q19 . 

15 

Q7 . Is x+n an "e" form? 
No- -go to step Q7A. 
Yes— go to step Q17. 

2 0 Q7A. Is x+n a "c" form? 
No- -go to step Q9 . 
Yes --go to step Q8 . 

Q8 . Is (x+n) -1 a 40 level verb? 
25 No- -go to step Q17. 
Yes --go to step Q18. 

Q9 . Is- x+n an "f" form? 
No- -go to step Qll. 
30- Yes- -go to step Q10. 
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Q10. Is (x+n) -1 either a 40 ,41, or a 42 level verb? 
(Note, it is assumed that it will be very rare that such 
irregular verbs whose infinitive and past participle forms 
are the same, (i.e., "f" forms), would also be strictly 
5 intransitive, AND that a writer would precede the past 
participle of such a verb with a "be" verb) . 
No- -go to step Q17. 
Yes- -go to step Q18. 



10 Qll. Is x+n any one of the following: d41, d42, d43 or d45? 
No- -go to step Q13. 
Yes- -go to step Q12 . 



Q12 . Is (x+n)-l either a 41 or a 42 level verb? 
15 No- -go to step Q17. 
Yes--go to step Q18.' 



Q13 . Is x+n either of: d44 or d46? 
No- -go to step Q15. 
20 Yes--go to step Q14 . 



Q14 . Is (x+n)-l a 41 level verb? 
No- -go to step Q17 . 
Yes--go to step Q18. 

25 

Q15. Is x+n a "g" form? 
No--go to step Q17 
Yes- -go to step Q16 . 

30 Q16. Is (x+n)-l a 42 level verb OR a GERUND HELPER VERB 
(w99) ? 
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Wo- -go to step Q17. 
Yes--go to step Q18. 

Q17. ["yes" to Q7 or "no" to Q8 , 10,12,14,15,16]- Then FOLD 
5 but NOT at the space before x. Instead, fold at the space 
BEFORE x+n. Place the new segment in LANE X (relative to the 
other prior generations of folding from the original 
segment /sentence ) , SLOT B. Then go to step Q19. 

10 Q18. ["Yes" to Q8 ., 10, 12, 14, 16] . Then add 1 to n and go 
back to step Q6 using n+1 instead of n. (That is, inspect 
the next word that comes after x+1 and see if it is a verb 
or not, and proceed accordingly.) 

15 Q19. Are there still segments that exceed the MAXIMUM ROW 
VALUE (or the . space available to the right)? 
No --stop. 

Yes --go back to step Q2 . 

20 Q20. Is 1 there a 41 level verb in the segment (or remaining 
segment) ? 

No- -go to step Q34 . 
Yes- -go to step Q21. 

Q21. For the first (next) 41 level verb, (x) , in the segment, 
is x beyond the MINIMUM ROW VALUE (>MIN)? 

No- -go back to. step Q20 and check the segment for a 41 level 
verb distal to x. 
Yes--go to step Q22. 

Q22. Is x an "e" form? 

60 
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No- -go to step Q22A. 
Yes--go to step Q33 . 

Q22A. Is x a "c" form? 
5 No- -go to step Q24 . 
Yes--go to step Q23. 

Q23. Is (x-1) a 40 level verb? 
No- -go to step Q33. 
10 Yes--go to step Q32 . 

Q24. Is x an "f" form? 
No- -go to step Q26. 
Yes- -go to step Q25. 

15 

Q25. Is (x-1) a 40, 41, or a 42 level verb? 
No- -go to step Q33. 
Yes--go to step Q32. 

2 0 Q2 6. Is x any one of the following: d41, d4 2, d4 3 or d4 5? 
No- -go to step Q28. 
Yes- -go to step Q27. 

Q27. Is (x-1) a 41 or 42 level verb? 
25 No--go to step Q33 . 
Yes- -go to step Q32 . 

Q28. Is x either one of: d44 or d46? 
No--go to step Q30. 
30 Yes--go to step Q29. 



61 



WO 99/39255 



PCT/US99/02227 



Q2 9. Is (x-1 ) a- 41 level verb? 
No- -go to step Q33. 
Yes--go to step Q32 . 

5 Q30. Is x a »g" form? 
No--go to step. Q32. 
Yes --go to step Q31. 

Q31. Is (x-1) a 42 level verb OR a GERUND HELPER VERB (w99 ) ? 
10 No — go to step Q33 . 
Yes- -go to step Q32. 

Q32. .["Yes" to Q23, 25, 27, 29, or 31] Goto Q32A. 

15 Q3 2A. Is x a 45 or 46 level verb? 

No- -then do NOT fold at the space before x. Instead, go back 
to step Q2 0 and check for another verb in the segment distal 
to x. (If there are no more 41. level verbs in the segment, 
step Q20 directs inquiry to step Q34 for 42 level verbs. 

20. Similarly, inquiry is directed from step Q34 to step Q36 for 
43/44 level verbs, and from step Q36 to step Q38 for 45/46* 
level verbs) . 
Yes- -go to step Q40. 

25 Q33. ["yes to Q22 of "No" to Q23, 25, 27, 29, 30, or 31] Go 
to Q33A. 

Q33A. Is x a 45 or 46 level verb? 

No- -then POSSIBLY fold at. the space before x, but check (x+n) 
30 first . Go back to step Q6 . 
Yes- -go to step Q42 . 
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Q34. Are there any 42 level verbs in the segment (or 
remaining segment) ? 
No--go to step Q36. 
Yes- -go to step Q35. 

5 

Q35. For the first (next) 42 level verb, x, in the segment, 
is x beyond the MINIMUM ROW VALUE (>MIN)? 

No- -go back to step Q34 and check for the next 42 level verb 
in the segment distal to x. 
10 Yes- -go to step Q22 . 

Q36. Are there any 43 level verbs OR any 44 level verbs in 
the segment (or the remaining segment)? [Note: verbs at 
either level 43 or 44 are looked for at this step] ? 
15 No- -go to step Q38. 
Yes--go to step Q37. 

Q37. For the first (next) 43/44 level verb, x, in the 
segment, is x beyond the MINIMUM ROW VALUE (>MIN)? 
20 No- -go back to step Q36 and check for the next 43/44 level 
verb in the segment distal to x. 
Yes- -go to step Q22 . 

Q38. Are there any 45 level verbs OR any 46 level verbs in 
25 the segment (or the remaining segment)? [Note: verbs at 
either level 45 or 46 are looked for at this step] ? 
No- -GO BACK TO THE USUAL ALGORITHMS AT STEP 18 and resume 
inquiry using hinge word level b50. 
Yes--go to step Q39. 
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Q39. For the first (next) 45/46 level verb, x, in the 
segment, is x beyond the MINIMUM ROW VALUE (>MIN)? 
No- -go back to step Q38 and check for the next 45/46 level 
verb in the segment distal to x. 
5 Yes- -go to step Q22 . : 

Q4 0. ["Yes" from step Q3 2A] . Is x a 45 level verb? 
No-- [x is therefore a 46 level verb] . Fold at the space 
AFTER x. Then go to step Q19 
10 Yes- -go to step Q41. 

Q41. [x is a 45 level verb] . Is (x+1) a verb? [Note: by now, 
if (x+1) is indeed, a verb, then (x+1) should be either a 45 
or 4 6 level verb] 
15 No--then do NOT fold at the space before, x. Instead, go back 
to step Q38 and check for the next 45/46 level verb in the 
segment distal to x. 

Yes --then DO NOT FOLD at the space before x. INSTEAD, FOLD 
at the space before (x+1) , (which is also the space AFTER 
20 x). . Place the newly formed segment in LANE X (relative to the 
other prior generations of folding from the original 
segment/ sentence ) , SLOT D. Then go to step Q19. 

Q42. ["Yes" from step Q33A] Is (x+1) a verb? 
25 No--go to step. Q43 . 

Yes--then fold at the space before (x+1) , which is also the 
space after x. Place the new segment in LANE X (relative to 
the other prior generations of folding from the original 
segment /sentence) , SLOT D. Then go to step Q19 . 

30 

Q4 3. Is x a "c" form or an "f" .form? 
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No- -go to step Q45. 
Yes--go to step Q44. 

Q4 4. Is (x-1) the word "to"? 
5 No- -go to step Q45. 

Yes--then fold at the space before "to". If the word 
immediately before "to", is "and" or "or", then fold before 
"and" or "or" instead of before "to". 

If the "and" word or the "or" word and the word "to" are all 
10 greater than the Minimum Row value, (>MIN) , then fold before 
the word "and" or the word "or" or the word "to" , whichever 
is first. If the word "and" or the word "or" or the word 
"to" preceding x is less than the Minimum Row Value (<MIN) , 
then do not fold- - instead go back to step 38 and check for 
15 45/46 level verbs in the segment distal to x. 

Place the new segment in LANE X (relative to the other prior 
generations of folding from the original segment/sentence) , 
SLOT C. Then go to step Q19. 

20 Q45. Is (x-1) a word on the DEFINITE SUBJECTIVE PRONOUN LIST 
[list x99; these words are I, we, he, she, they, who, etc.]? 
No- -go to step Q46. 

Yes- -then fold at the space AFTER x. Place the new segment 
in LANE X (relative to the other prior generations of folding 
2 5 from the original segment /sentence) , SLOT D. Then, go to step 
. Q19. 

Q46. Is (x-1) a word in the PRE -DETERMINER SET [y99] ? 
No- -go to Q46A. 



65 



WO 99/39255 



PCT/US99/02227 



Yes--tnen do NOT fold at the. space before x and go back to 
step Q38 to check for 45/46 level verbs in the segment distal 
to x. 

5 Q46A. Is x an "f", "d" or "g" form? 
No- -go to step Q47. 

Yes- -then fold at the space before x. If the word "and" or 
the word "or 11 is the word before x, (x-1) , then . do not fold 
before x. Instead, if the "and" word or the "or" word are 
10 greater than the Minimum Row value, (>MIN) , then fold before 
the word "and" or the word "or". If the word "and" or the 
word "or" preceding x is less than .the Minimum Row Value 
(<MIN) , then do not fold- - instead go back to step 38 and 
check for 45/46 level verbs in the segment distal to x. 

15 

Q47. Is x a 45 level verb? 

No- -then dp NOT fold at the space before x and go back .to 
step Q38 ..to check for 45/46 level verbs in the segment distal 
to x . 

20 Yes- -go to step Q48. 

Q48. Is (x+1) a word in the . POST - DETERMINER SET [z99] ? . 
No- -then do NOT fold at the space before x and go back to 
step Q38 to check for 45/46 level verbs in the segment, distal 
25 to .x. 

Yes --then FOLD at .the. space BEFORE x. (If the word "and" or 
the word "or" is the word before x then do not fold before 
x. : Instead, if .the "and" word or the "or" word are greater 
than the Minimum Row value, (>MIN) , then fold before the word 
30 "and" or the word "or". If .-the word "and" or the word "or" 
preceding x is less than the Minimum Row . Value (<MIN) , then 
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do not told- -instead go back to step 38 and check for 45/46 
level verbs in the segment distal to x. ) 

Place the. new segment in LANE X (relative to the other prior 
generations of folding from the original segment /sentence) , 
5 SLOT C. Then go to step Q19. 
(End of Verb Loop) . 

ADDITIONAL ASPECTS OF THE INVENTION 
Text Enhancement Using Reader-Performer Actions 
Text presentation can be enhanced using actions of a 

10 reader or reader-performer as inputs and a variety of audio- 
visual effects as outputs. In one embodiment, a reader or 
reader-performer reads text aloud while varying pitch, tone, 
volume, and pauses for effect. The term "reader-performer 11 
is used to distinguish over the reader of the enhanced text 

15 and to note that reading aloud can include many actions in 
addition to speech. The spoken text is recorded for use in 
displaying the text. In one embodiment, the spoken text is 
recorded electronically and analyzed for spoken action 
attributes such as pitch, tone, volume, and pauses. In a 

20 preferred embodiment, spoken text attributes are analyzed and 
the analyzed Attributes are stored in addition to the spoken 
text itself. The attributes such as pitch, tone and volume, 
are stored and mapped to correspond to the text letters, 
syllables and words which are also stored, such that the 

25 attributes can be extracted and reproduced in some fashion 
in correspondence with the original text . Reader-performer 
action attributes can be presented as display attributes such 
as font, intensity, font line thickness, font character 
height, character color, background color, inter-character 

30 spacing, inter-word spacing, interline spacing and inter- 
sentence spacing. 
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xn one example of. ..the invention, the volume of the 
reader is reproduced as font intensity and the pitch is 
reproduced as font thickness, with higher pitches being 
reproduced as narrower characters and lower pitches being 
5 reproduced as wider characters. Font intensity can refer, to 
. the number of pixels set per unit area to a different color 
than the local background pixels. In one example, intense 
text is black text on white background while less intense 
text is gray text on. white background. In another example 

10 of the invention, the character color is varied in • accordance 
.with the pitch. For example, higher pitched words are 
reproduced more toward the red end of the ROYGB IV spectrum 
while lower pitched words are reproduced more toward the 
violet end of the ROYGB IV spectrum. In .another example, the 

15 text is displaced from the normal horizontal base line of the 
text in accordance, with the pitch of the reader-performer. 
One embodiment displaces text upward for. higher than average 
pitch and downward for lower than average pitch. 

In another example of the invention, the reader- 

20 performer's spacing and duration of pronunciation of specific 
words is reproduced in enhanced text with spacing of letters, 
words and sentences. The reader's word pronunciation time 
and inter- word and inter- sentence spacing can be recorded, 
allowing normal inter-word and inter- sentence spacing .to be 

25 measured. Words pronounced more slowly than normal can be 
reproduced with additional spaces between letters of- the 
word. Longer than . normal inter- word time spaces .can be 
reproduced using longer than normal inter-word distance 
spaces on the displayed text. Even longer, time spaces can 

30- be reproduced by displaying the . separated words or phrases 
on new lines. Extremely long time spaces can be displayed 
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as "the separated words or phrases on new lines that are 
vertically separated by a greater distance than normal. 

Hand Gestures 

5 In another aspect of the invention, the reader-performer 

actions recorded during reading include hand and finger 
gestures. The position and orientation of the hands is 
preferably recorded and stored to correspond to each word 
read aloud. Orientation refers to the direction pointed to 

10 by the hands, fingers, or palms. In a two dimensional plane, 
the orientation may be recorded as a two dimensional vector. 
In a three dimensional model, the hands may be recorded as 
a three dimensional vector. The positions may be recorded 
as the position relative to the reader-performer's shoulders 

15 or other body reference point. 

In selected, appropriate text selections, the 
vertical and horizontal displacement of text can be varied 
in accordance with text content. One example of this would 
be display of the sentences "On one hand and "On the 

20 other hand The first phrase could be displaced 

horizontally to the left while the second, opposing sentence 
could be displaced horizontally to the right. Similar, 
vertical displacements could be used to contrast hand actions 
such as "He promised this, but delivered only this". 

25 Hand position and orientation can be recorded using 

known technology such as the placement of infrared reflecting 
dots at strategic locations on the hands. The reflections 
of projected infrared lights can be captured and stored, 
allowing later reproduction of hand movement . In another 

3 0 method, the reader-performer uses gloved hands and the hand 
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positions are recorded directly with a digital camera using 
the contrast of the hands against the darker background*. 

Facial Expressions 
5 In another aspect of the invention, facial expressions 

of the reader-performer are recorded during reading and. 
stored in correspondence with the words being read. One 
embodiment records eye or eyelid shape, eye openness, eyebrow 
position, head- position, jaw position, and mouth shape. The 

10 facial expression actions of the reader-performer can be 
recorded on a per word basis and displayed 'back on a per line 
basis. In one embodiment, the. extreme positions are used to 
represent the position for the entire line. In • another 
embodiment, an average position is used to represent the 

15 position for the entire line. In another embodiment , the 
facial expressions are used to vary the presentation of the 
text itself. In one example, the degree of openness of the 
mouth- is used- to vary the. degree of openness' of certain 
closed vowels , such as "0" . ' The more the mouth of the 

20 reader-performer is open, the larger the O and the opening 
within.it become. In another example, the degree of height 
of certain .letters such as "W" or "T" is varied depending on 
the degree of openness of the eyelids. The facial expression 
representation described above is combined with text swiping 

25 previously described in one aspect of the invention. In one 
embodiment, a. line drawing of a human face is reproduced 
above the word being swiped or highlighted. ■- , The facial 
■ features on the animated face change dynamically. • In another 
embodiment, one face -is represented beside each line ■ of text , 

30 with the face animated as the line is swiped. In- yet another 
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embodiment, a face is presented near a phrase to be enhanced, 
and a static facial expression shown on the face. 

Text Presentation Along a Curved Line 
5 In another aspect of the invention, text is displayed 

along a curved baseline rather than a conventional horizontal 
straight line as a function of reader-performer actions. In 
one embodiment, the curved line is either invisible or 
substantially less visible than the text displaced. The 

10 curve in one embodiment is varied in accordance with some 
action of the reader-performer. In one example, the 
horizontal displacement of the curve is greater for higher 
pitches and less for lower pitches. The word pitch can be 
obtained from a phonetic dictionary e.g. the pitch of the 

15 word can be looked up rather than obtained from a speaker's 
voice. In another example, the horizontal displacement is 
varied in accordance with the volume of a reader-performer's 
voice. In one example, the reader-performer action is 
sufficiently damped so as to maintain an evenly flowing 

20 smoothly curved line. 

Text Bending 
Introduction 

In spoken language, the variability in tone, pitch, and 
25 volume from one word to the next creates a signal that can 
be thought of as a curve or trajectory. From the 

pronunciation of just a few words of a sentence, the 
beginning of such a curve is "drawn" on an "aural 
chalkboard" . The listener uses this initial curve to build 
3 0 and anticipate, in the mind, the structure of the phase or 
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. sentence as a . whole, even before it has been completely 
uttered by the speaker. 

This powerful information makes speaking-listening very 
efficient. However, current text presentation technology 
5 does not readily permit a system that could consistently and 
meaningfully depict these aural curves in graphical form. 
Instead, the reader must resuscitate the elocutionary force 
of the sentence by decoding the symbols of the text and 
recreating an aural representation of the sentence as a whole 
10 in the mind. 

Within a sentence, segments can be identified using 
content analysis that would have characteristic prosodic 
contours. The present invention describes a method to create 
graphical correlates of these contours of sentence segments, 
15 and to integrate these graphical sub-units into a larger 
structure to depict the sentence as a whole. 

The Process 

1. Sentence segments are identified using the "sentence 

2 0 folding" algorithms previously described . 

2. Instead of horizontal displacement rules, a set of 
curves is defined and each sentence segment is assigned to 
one of these curves . 

3 . The curves are then arranged on the reading field in 
25 a pattern that unambiguously depicts the sequence of the 
segments (e.g., from top down);" the position of segments 
within these arrangements can be. modified slightly-, without 
changing .the implied- sequence, in order to optimize /the 
■ perception of the curves and the reading of the sentence. 

3 0 • 
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A sample of a master curve 340 which defines the size 
and orientation of segment curves is depicted in FIG. 13. 
A series of letters, such the letter "H" at 344, lie on curve 
340. An arrow 342 at the top of the curve indicates the 
5 position with which a sentence segment curve that was drawn 
from a Head letter (A through G) to a Tail letter (H through 
K) would be oriented on the reading field and relative to 
other sentence segment curves . 

The Head letter position on the curve is determined by 

10 the circumstances of the beginning of the segment. The Tail 
letter position is determined by the circumstances of the end 
of the segment. These circumstances are summarized in a 
table 350 in FIG. 14 . 

After the Sentence folding algorithms have identified 

15 segments of the sentence which will occupy separate rows (in 
this description, they will occupy separate curves) , the 
length of the segment is measured. A line is drawn that 
corresponds to this length. The line is then "bent" so that 
the shape (in degrees and orientation) of the newly formed 

2 0 curved line conforms to the Head-Tail letter positions 
specified in FIGS. 13 and 14. The "dangle" point, or the 
position of the arrow at the top of the curve, is also 
identified . 

The size of a segment curve is determined by its length, 
25 in characters; however, regardless of its length, the shape 
and orientation of the segment curve will be determined by 
the process described above. If a segment is very short, 
such that the curved segment would be too small and the curve 
too extreme, a minimum curve would be defined. Short 
30 segments with an H tail would then be placed at the Head 
letter specified by their beginning circumstances-but the 
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remainder of the segment would follow the curvature specified 
by the minimum curve path and the "dangle point" would also 
be specified by the minimum curve. Similarly, short segments 
with an I, J or K tail would be placed at the Tail letter 
specified by their ending circumstances, and the remainder 
of the segment would follow the curvature specified by the 
minimum curve path and its "dangle point" . 

Parameters for maximum line length would likely prevent 
segments from being, so long, i.e., have so many characters, 
that their curves would be very large and relatively flat. 

The newly formed curves would then be positioned, in 
this example, with the first segment of the sentence on-tcp. 
In one embodiment, the. location of the dangle point is a 
function of the next segment could be developed that was a 
function of the tail of the segment preceding it. After all 
of the curves are in position, the characters of text for 
each segment are positioned , on the curve and the lines and 
the dangle point are erased. A sample of this process' is 
shown in FIGS. 15 and 16. 

New Qualities Imparted by the Text Bending Process 
This text preisentation method allows the reader to 
recognize, by a particular curve in the layout of its 
characters , an individual segment • s structure and ' function 
(not just sequential position) in the overall structure of 
the sentence. This provides graphical information that 
facilitates cognitive processing of the sentence's' segments 
while reading. This is similar to the way 'the word-to-word 
variability in pitch and tone in speech creates an aural 
curve that helps the listener predict how long a phrase is 
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going to be and whether or not it will be the end of a 
sentence or clause. 

Conventional text only uses punctuation marks, which are 
often not discovered until the reader has already read the 
5 entire phrase-this prevents the reader from making, in the 
mind, a corresponding phonological model of what was read 
until after the entire segment is read. The curves created 
by my process allow this type of phrase structure and 
function information to be known in advance, so that this 

10 information can be used in word recognition and phrase 
comprehension. These curves are also defined by content 
(i.e., hinge words) other than punctuation marks. They 
also further differentiate segments created in the sentence 
folding process, by depicting circumstances of both the head 

15 and tail of a segment. 

Referring now to FIG. 15, a sentence 380, the first 
sentence of the Gettysburg Address shown in cascade form as 
generated by algorithms (Step 1 under "The Process" heading 
above) . A column 386 specifies a start letter 382 and an end 

20 letter 384, for each line of the sentence. This determines 
the type of curve to be curve to be assigned to each segment. 

An integration of these individual segment curves, from 
Step 3, is illustrated in FIG. 16. For example, sentence 408 
is bent over a curve 400, starting at an end position A, 

25 ending at an end position 404, and having a dangle point 
denoted by 406. Subsequent segments are placed beneath 
preceding segments by placing the "dangle point" 
approximately two -thirds the way across the curve above them. 
Additional content-based rules could optimize these "dangle 

30 point 1 positions. In one embodiment, the lines and Head/Tail 
letters do not appear, only the characters of the text 
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appear. A series ;,of .-bent . ..text... curves generated by the 
example in FIG. 15 are illustrated by curves 410, 412, 414, 
416 , and 418 . 

The curves enhance the "visual prosody" of the text 
5 presentation. Each sentence acquires an even more unique 
visual appearance. The curves also break up the monotony of 
linear presented text, which may reduce fatigue of the eye 
muscles . 

10 Text Hierarchy Display 

Another aspect of the present invention provides an 
improved means for displaying text hierarchies and the 
location of text being read within those hierarchies. A 
conventional text hierarchy, listed from higher to lower 

15 rank, includes volume number, section, chapter, sub-section, 
page, paragraph, and sentence. The present invention 
provides . a method for informing the reader of both the number 
. of the units in each hierarchy and the position of the text 
being read within that hierarchy. 

20 Referring to FIG. .17, an unopened book 200 is 

illustrated. The book is selected for opening by the reader, 
as indicated, at "X." ■ The reader selection can be performed 
using any method known in the art including cursor movement 
and selection with a mouse. Referring, now to FIG. 18, book 

25 200 has been selected, opened and displayed as a. plane 202 
filling .a substantial portion- of a display screen 201. 
Opening book . 200 has revealed a plurality of chapters 206 
each having' an exposed margin 204. In one embodiment, the 
chapter margins have the. chapter number inscribed thereon as 

30 indicated at 208. Reader selection of Chapter 4 is indicated 
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at '"X" in FIG. 18, causing : the chapters to separate at 
Chapter 4 as illustrated in FIG. 19. 

Referring now to FIG. 19, the result of selecting 
Chapter 4 is illustrated. Chapters 206 are illustrated 
5 having separated to display Chapter 4, exposing pages 210 
within the chapter. Pages 210 have vertical margins 212 
exposed. In one embodiment of the invention, pages are 
numbered and arranged to mirror the pages in a print edition 
of the book. In another embodiment of the invention, pages 

10 are numbered to take advantage of the enhanced format of the 
text presentation, with no attempt made to mirror any print 
edition of the book. Specifically, the pages can be 
formatted and numbered to contain only a maximum number of 
paragraphs or a maximum number of words, whichever is reached 

15 first. In this embodiment, paragraphs need not be broken 
across pages. In this embodiment, the number of paragraphs 
and words in the maximum are preferably set to values 
approximating those of a normal published page. In yet 
another embodiment of the invention, the number of pages in 

20 a chapter is set to a maximum, for example 50, with the 
paragraphs evenly divided into those 50 pages. In this last 
example, at most only 50 pages are presented on the display 
screen. Reader selection of page 3 is indicated at "X" in 
FIG. 19, causing the pages to separate at page 3 as 

25 illustrated in FIG. 20. 

Referring now to FIG. 19A, the result of selecting 
Chapter 4 in FIG. 18 is illustrated in an alternate 
embodiment. Chapters 206 are illustrated having separated 
to display Chapter 4, exposing pages 210A within the chapter. 

30 Pages 210A have horizontal margins 212A exposed. In this 
embodiment, the nesting of the text hierarchies is denoted 
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■Jay tne margins having . a shorter length for lower ranked 
hierarchies. In the example of FIG. 19A, pages 210A have 
margins oriented substantially parallel to Chapters 2 06, but 
with the margin .212A of pages 210A having a shorter length 
5 than the margins of Chapters 206. 

Referring now to FIG. 20, the result of selecting page 
3 is illustrated. Pages 210 have separated at page 3 to 
display paragraphs 214 within. In the initial display, only 
paragraph horizontal lower margins 216 are displayed. Reader 
10 selection of paragraph 3 is indicated at "X" in FIG.. 20, 
causing the paragraphs to separate at paragraph 3 as 
illustrated in FIG. 21. 

Referring now to FIG. 21, the result of selecting 
paragraph 3 is illustrated. Paragraphs 214 have separated 
15 at paragraph 3 to reveal sentences- 218 having vertical 
margins 220 within. In one embodiment, the first sentence 
is initially displayed, ready for. reading, as illustrated at 
. first sentence 222. In another embodiment, only margins 220 
are initially displayed upon opening the paragraph. Reader 
20 selection of sentence 4 is indicated at "X" in FIG. 21, 
causing the sentences to separate at -sentence 4 as 
illustrated in FIG. 22. 

Referring now to FIG. 22, the result of selecting 
sentence -4 at 223 is illustrated.* Sentence 4 is ' the sentence. 
25 currently being read. In one embodiment, ■ the completion of 
reading sentence 4 is indicated by the reader activation of 
a ..computer peripheral device such as 'a mouse button.. In 
another embodiment, the completion of reading a sentence is 
'indicated by the passage of a time period calculated to 
30 correspond to the: weight of the sentence and the reader's 
- recent reading speed. In a preferred embodiment, the 
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completion of sentence reading is switchable between a time 
based mode and a reader actuated mode. In one embodiment, 
speed is reader adjustable using input such as a sliding 
scroll bar. This allows the reader to increase and decrease 
5 speed easily to suit the passage being read. 

When completion of reading a sentence is indicated, the 
next sentence is advanced into position. In FIG. 22, in one 
embodiment," sentence 4 slides quickly to the left to reveal 
sentence 5 underneath. In another embodiment, sentence 4 and 

10 all subsequent sentences in the paragraph slide to the left 
by the width of one vertical margin, with sentence 4 
continuing to slide left to takes its place underneath 
sentence 3. In this last embodiment, the sentence being read 
can be maintained in the same position by moving the sentence 

15 before the text of the sentence becomes visible to the 
reader. After the last sentence in the paragraph is read, the 
next paragraph is opened to reveal the sentences within, 
resembling closely the illustration of FIG. 21, but with the 
next paragraph exposed or pulled down. 

20 In a preferred embodiment of the invention, alternate 

text hierarchies are represented by planes having alternate 
horizontal and vertical exposed margins. Stated differently 
using current Microsoft Windows terminology, alternate text 
hierarchies are represented by alternately horizontally and 

25 vertically tiled planes. In one embodiment, the outer, 
higher ranked text hierarchies appear to be behind the inner, 
lower ranked text hierarchies, as the opened higher ranked 
text hierarchies have the next lower ranked text hierarchy 
displayed thereover. In another embodiment, the outer, 

30 higher ranked text hierarchies appear to be closer to the 
reader, with the inner, lower ranked hierarchies displayed 
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turtner rrom the viewer. In this embodiment, the currently 
opened text hierarchy is preferably not displayed, except for. 
the currently being read sentence. In one example using 
horizontally tiled text units and having a text unit number 
5 3 opened, the text units appear as a deck of cards, splayed 
open, having 1 on top of 2 on top of the top edge of 3 and 
4 under 3 and 5 under 4. The units toward the . top of the 
screen appear closer to the viewer than the units, toward the 
.bottom of the screen.- This is the arrangement used in the 

10 embodiment of FIG. 22 with respect to paragraphs, but with 
paragraph number 3 opened. 

In another example, text units 1 through 3 are as 
previously described, but text unit 4 is on top of the lower 
edge of text unit 3, and text unit 5 is on top of all but the 

15 upper edge of- text unit 4. In this arrangement, the text 
units appear to grow further -away from the viewer from the 
outer margins until the opened text unit is displayed, after 
which the text units appear to become - closer to the viewer 
until the opposite outer margin reached. This arrangement 

2 0 is similar to having a series of nested theater curtains, the 
outer curtains being in front, the more inner curtains being 
behind the outer curtains, and the' more inner curtains 
revealing a smaller aperture than the outer curtains. 

In the general case, the orientation of the margins is 

25 varied depending on the text hierarchy level represented . 
While the illustrated embodiments have the margins oriented 
alternately horizontal and vertical, 90 degrees offset, in 
the general case, the -of f set could be less. In one example, 
the highest level hierarchy has horizontal margins (extending 

30. from 9. O'. clock to 3 O' Clock), and. the next ,. lower level is 
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outset t>y 30 degrees, extending from 10 O'clock to 4 O'clock. 

Referring again to FIG. 22, the display of the current 
"book" being read can be explained without reference to how 
5 the reader came to be reading a particular sentence. The 
next lower text hierarchy is indicated by chapters 2 06 which 
are horizontally tiled, having horizontal lower margins 204 
exposed. The next lower text hierarchy, pages 210, are 
displayed superimposed over chapters 206. Pages 210 are 

10 vertically tiled, having vertical margins 212 exposed. The 
next lower text hierarchy, paragraphs 214, are displayed over 
pages 210. Paragraphs 214 are horizontally tiled, having 
horizontal margins 216 exposed. The next lower text 
hierarchy, sentences 218, are vertically tiled, having 

15 vertical margins 220 exposed. 

The reader is able to visualize the location of the 
sentence being read within the paragraph, the paragraph 
within the page, the page within the chapter, and the chapter 
within the book. Using known three dimensional shading and 

2 0 perspective display techniques, e.g. planar edge shading and 
bevelling, nested planar text hierarchies can give the reader 
a three dimensional feel of the location of the text being 
read. 

In one embodiment, the sentences are displayed in 
25 horizontally sliding planes, In another embodiment, the 
sentences are displayed in a series of horizontally tiled 
planes that slide horizontally, similar to paragraphs 214 in 
FIG. 22. In one embodiment, sentences are always set to be 
displayed as either horizontally or vertically tiled planes, 
30 with the higher ranked text hierarchies alternating as 
horizontally and vertically tiled planes. 
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In some text bodies, there may be a large number of 
units, for example, a very large number of pages in a 
chapter, or a book with no chapters. To deal with this 
situation, an artificial hierarchy can be created.. In one 
5 embodiment, an "Order of Ten" hierarchy can be created. For 
example, if the number of chapters is greater than 50, an 
artificial unit of "10 Chapters"- can be created. This 
artificial unit can be created as either a higher ranked text 
hierarchy to be displayed as such or simply as a unit of 

10 similar rank to be tiled the same but displayed differently. 
In one example, the unit of "10 Chapters" is tiled vertically 
while the chapters are tiled horizontally. In another 
example, the units of "10 Chapters" and . chapters are. both 
tiled horizontally, but with the "10 Chapter" unit having a 

15 darker color or otherwise different appearance. 

Text Display Across Opposed Pages 
In another aspect of. the invention, a method- for 
displaying text on subsequent pages is provided. Referring 

2 0 now to FIG. 23, a left page 2 50 having a right margin 2 52 is 
illustrated as is a right page 254 having a left margin 255, 
.obscured by right margin 252. Page number 3 is displayed as 
left page 250 and page number 4 is displayed as right page 
254. Page number 3 is indicated as being read by the "X." 

25 Upon completion of reading page number 3, this, can be 
indicated to the reading system by reader action or by 
completion of a .time interval. Upon completion of reading 
page number 3, . indicated by arrow 251, page number 4 is 
displayed "in- front of" page number 3, with right.-page 254 

30 left margin 255 obscuring left page 250 right margin 252. 
.Upon completion of reading page number 6, indicated by arrow 
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'453, new pages are displayed, with page number 5 being 
displayed as left page 2 50 and page number 6 being displayed 
as right page 254. In this fashion, pages are alternated 
left and right to mimic the familiar pattern of paper books 
5 readers are accustomed to. 

Referring now to FIG. 24, another embodiment of the 
invention is illustrated. A left page 2 60 having a right 
margin 262 is illustrated as is a right page 264 having a 
left margin 265, obscured by right margin 262. page number 

10 3 is displayed as left page 260 and page number 4 is 
displayed as right page 264. Page number 3 is indicated by 
the "X. " Upon completion of reading page number 3, indicated 
by arrow 261, page number 4 is brought to the front such that 
left margin 265 obscures right margin 262. In addition, upon 

15 the reading completion of page 3, page number 3 is removed 
and replaced with page number 5. This configuration is not 
possible using traditional, paper bindings. Upon completion 
of reading page number 4, indicated by arrow 2 63, page number 
5 is brought to the front and page number 4 is removed and 

20 replaced with page number 6. 

The embodiment illustrated in FIG. 24 has the advantage 
of allowing text segments to be broken across pages while 
always providing the next page to be read on the screen. 
This allows the reader to advance from previously displayed 

25 text without having to wait for new display of text. For 
example, a text segment broken across page number 3 and 4 
could be read by the reader without requiring a pause for the 
contents of page 4 to be displayed. A text segment broken 
across page numbers 4 and 5 could be read by the reader 

30 without requiring a pause for the contents of page 5 to be 
displayed. In essence, the reader is able to read 
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electronically displayed text without having to wait for page 
flipping, while at the same time having the familiar 
presentation of text on opposing pages, a throw back to 
bound, paper books. The .middle configuration of FIG. 24 is 
not bound by binding. 

Text Display for Reading from Front to Back 
Referring now to FIG. 25, another aspect of the 
invention is illustrated in a screen display of text 280, 
having a first text line 282, a second text line 284, a third 
text line 286, and a fourth text line 288. Using perspective 
illustration techniques, first line 282 can be made to appear 
closer to the reader than second line 284, second line 284 
closer than third line 286, and third line 286 closer than 
fourth line 288. In one embodiment of the invention, text 
is displayed one screen or display page at a. time, with all 
lines on the display, even the most distant lines, being 
readable. In one embodiment, the line actively being read 
is indicated as being brighter or having higher contrast than 
the lines of text not having been read. The line actively 
being read can be estimated by advancing a brightening line 
wide cursor at the rate of the reader's estimated reading 
speed. In a variation of this embodiment, a line wide 
translucent filter is advanced over the line actively, read, 
such that text not being on the line being read appears 
slightly fuzzy and less readable than the text being read. 

Referring now to FIG. 26, the display of FIG. . 25 is 
illustrated as a modified display page 290, with the text 
having been advanced one line forward. First line 2 82 has 
been forced forward off the display while second line 284 is 
now at the forefront. In this embodiment of the invention, 
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text can De advanced.. a -line at a time, toward the reader. 
With current technology, the text can be made to scroll 
smoothly forward toward the reader. A perspective effect can 
be achieved by making the lower text lines with larger fonts 
5 and greater interline distances. Three dimensional fonts can 
also be used. In a preferred embodiment, the text is 
displayed as enhanced text after processing, using folding 
methods described above. 

In an alternate embodiment, text is displayed to appear 

10 as being displayed from front to back when read from bottom 
to top, as described above. In this embodiment, the text is 
displayed statically, one screen at a time, with text being 
paged through in multiple line chunks rather than being 
smoothly scrolled through. 

15 The embodiments illustrated in FIGS. 25 and 26 take 

advantage of the natural image processing selected for by 
human evolution. Specifically, humans, prior to reading, 
processed information while walking or otherwise moving 
forward, with newer information appearing first as further 

2 0 away and moving closer with time and movement through the 
landscape. English is written from top to bottom to allow 
the writer to read what has been written on the preceding 
line. Writing from bottom to top would cover up the lines 
just written with the writer's hand. This aspect is well 

25 known to left handed writers in a slightly different form. 
English is written from left to right, allowing right handed 
writers to see the words they have just written. Left handed 
writers cover up what they have just written, and often 
assume a cramped writing hand position in an attempt to 

30 compensate for this disadvantage. Publishing has heretofore 
adapted the top to bottom style used for hand written text, 
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without having to. The present invention frees text display 
from the top down convention, allowing display in a more 
natural, albeit unconventional display format. 

Varying Transition Patterns With Text Levels 
In another aspect of the invention, transition patterns 
between text displays is varied as a function of the level 
or hierarchy ranking of the text. In one embodiment, the 
transition between sentences within a paragraph is different 
than a transition between paragraphs. The transition between 
sentences can be varied as a function of the position of the 
sentence within the paragraph. The transition between 
paragraphs can be varied as a function of the position of the 
paragraph within the chapter or other text hierarchy within 
which it resides. 

In one example of the invention, transition between 
paragraphs is accomplished by dissolving the just displayed 
sentence, before displaying the next sentence. The dissolve 
can be a fine grained dissolve for the first paragraph in a 
chapter, a coarse grained dissolve for the last paragraph 
in a chapter, and a continuum of granularity therebetween for 
intermediately positioned paragraphs. In another example of 
the invention, each successive sentence in a paragraph could 
be displayed starting either at a more rightward position, 
a more downward position, or both. In this way, successive 
sentences in a paragraph would march either rightward, 
downward, or both with the progression of the paragraph. 

In another embodiment ' of the invention, a musical key, 
played by an instrument/ is associated with a paragraph to 
be displayed. In one example, the same key and. instrument 
is associated with every paragraph. A number of notes 
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corresponding to the number of sentences in the paragraph is 
played down the scale in that key at the start of the display 
of the paragraph. At the beginning of the display of each 
sentence, the corresponding note in the scale is played up 
5 or down the scale. In a corresponding example, a number of 
notes corresponding to the number or location of that 
sentence is played. In one embodiment, if the sentence 
contained more than one clause, a chord is played. In one 
embodiment, if the sentence contained contrasting expressions 
10 such as "despite" or "however", a minor or discordant chord 
could be played. In one embodiment, a different instrument 
and/or key is used for every paragraph. 



Temporal Protrusion 

15 In another aspect of the invention, certain words are 

selected to protrude temporally from the other words in the 
sentence. The selected words in one example are displayed 
before the remaining words in the sentence are displayed. 
In another example, the selected words are displayed after 

2 0 the remaining words are no longer displayed. In yet another 
example, the selected words are displayed both prior to the 
remaining words being displayed and after the remaining words 
are no longer displayed. The displayed before or after the 
remaining words are believed to receive more attention from 

2 5 the reader. Words displayed prior to the remaining words are 

believed to register with and partially analyzed by the 
reader prior to the reading of the remainder of the sentence, 
this is believed to make the reader aware of the word such 
that the reader is not caught unaware and having to back 

3 0 track. 
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in one embodiment, .the words are . selected based on the 
difficulty the reader is predicted to have with the selected 
words. In one example, words above a certain educational 
level are selected for temporal protrusion. In another 
example, words having a sound-spelling mismatch are selected 
for temporal protrusion. A sound- spelling mismatch refers 
to words whose pronunciation is not deriveable from the 
spelling. In yet another example, a word frequency 

dictionary is used, and words used with low frequency are 
selected for temporal protrusion. 

Prose Painting 
In another aspect of the invention, color is used in 
conjunction with text analysis to display the 
interrelationship of parts of a sentence with another. One 
embodiment of this method can include the steps listed below. 

a. Analyzing the sentence, subdividing the sentence 
into a plurality of text segments based on relationships of 
said text segments to each other. 

b. Organizing said text segments into a tree having 
a root parent node- and. a plurality of parent nodes and child 
nodes . 

c. Assigning each child node a attribute based on the 
relationship with the .parent node. 

d. . Assigning the root node a color. 

> e. For each . child node., beneath the root, node, 
assigning a color .to each child node based upon the color of 
the parent node modified by the relationship between the 
child node and the parent node. 
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£ . Repeating step e until all nodes have a color 
assigned . 

g. Displaying said text in lines in substantially the 
same order specified by the author using the color assigned 
5 in the tree. 

Referring now to FIG. 27, in one embodiment of the above 
recited algorithm, the parent-child relationships are 
selected from the group consisting of entity, action and 
modification. An original sentence 300 is subdivided into 

10 three text segments 3 02, 3 04, and 306, as indicated by a tree 
301. Text segment 302 has an entity relationship to parent 
300 , segment "304 has an action relationship to parent 300, 
and segment 306 has an action relationship to parent 300. 
Parent 300, in a generation 0 at 308 has an initial color 

15 triple (Red Green Blue) of R0O-GO0-B0O, as indicated in 
segment 300. The amount of color added to each generation 
of child segments can be a function of the generation number 
itself. In FIG. 27, 100 units of color are added to a first 
child generation at 310, 50 units of color are added to a 

2 0 second generation 312, and 25 units of color are added to a 
third generation 314. The color itself is added as a 
function of the parent-child relationship. In FIG. 27, Blue 
is added for Entities, Red for Actions, and Green for 
Modifiers . 

25 In FIG. 27, segment 302 is has an Entity relationship 

with parent 300 and is at the first generation level, so 100 
units of Blue are added. The amount of color added is less 
at each generation. The function of each word in the 
sentence is thus influenced most by the function of the 

30 largest segment of which it is a part. 
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New Qualities Imparted by the -Prose Paint Process ' 
Speech is a communication system in which individual 
uttered units, such as words, have discrete meanings, and a 
larger meaning is constructed by the relationships among a 
5 group of words. The sequence of words is important 

structural information that is used to build the meaning of 
the relationships among the words. Within sequences of 
words, smaller sequences of words have special relationships 
among them. In this way, the order . of two or more smaller 
10 sequences of words within a larger sequence of words is also 
a form of structural information that is used to build the 
meaning of the relationships among all the words. 

In addition to selecting the order in which words are 

15 uttered, a speaker also, pronounces each word, or group of 
words, with certain sound attributes that are in addition to 
the simple pronunciation of the phonemes that indicate what 
the word is. These additional sound attributes include the 
- pitch, volume and timbre with which the words are spoken. 

20 These sound attributes commute and combine in that a 
particular word within a phrase will be modified relative to 
what. these additional sound attributes are for -the phrase as 
a whole. - 

These additional pronunciation attributes, such as 

25 pitch, volume and timbre, (hereinafter referred to as 
intonational attributes) - therefore represent a 

multi-dimensional system of values ■ that can be combined' and 
which commute across successive levels of differentiation of- 
word groups into smaller sub-units within the larger word 

30 groups. These values represent the relationship of the word 
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(or words] to the larger unit of the group of words it was 
a part of . 

In addition, each sub-unit is kept within a range of 
intonational values that is appropriate for its immediate 
5 context. A larger unit, which may contain several sub-units 
of its own, similarly will relate to the yet larger unit 
containing sub-units like itself, with a change in one these 
same intonational values that is appropriate for this larger 
context . 

10 For example, a careful audition of the sentence: "The 

purple hat of the purple clown was put into a purple 
box. "-will discern that the intonational values of each of 
the words "purple" appropriately set the word "purple" apart, 
in a tonal way, from the larger units the word "purple" is 

15 modifying in each case. In the first case, "The (purple) 
hat", is the principle entity of the sentence as a whole: the 
intonational value of "purple" in this case is built up from 
a baseline set of values used to represent the principle 
entity . 

20 In the second case, the phrase "of the (purple) clown", 

itself is a segment that has a modifying relationship to the 
entire subject phrase. This second "purple" therefore has 
a lower volume than the first "purple" but still has a pitch 
that sets it apart, in a tonal way, from "clown", in the same 

25 way that the first "purple" set itself apart from "hat". 

In the third case, the entire phrase-- "was put into a 
purple box"-- is varied in a different tonal dimension, (the 
timbre is sharper) , to set it apart from the first half of 
the sentence, as a way of depicting that this segment is in 

30 an "action" dimension relative to the sentence. The 
sub-units of this phrase, retain this baseline timbre 
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dimension value, , and then modify it . by changing the 
intonational values, of- each sub-unit based on the 
relationship of the sub- unit to the larger segment they were 
a part of. In. this way, the third "purple" .still" has, in the 
5 smaller context of its relationship to "the (purple) box", 
a pitch that sets it tonally apart from "box", but it also 
carries a slightly sharper timbre than the first two 
"purple" s because it is also in the ".action" dimension as a 
part; of "was put into a (purple) box." 

10 To further illustrate this intonational structure, 

notice how the word "hat" has two different sets of 
i.ntonational values in the following sentence: "The purple 
hat of the purple clown was put into the hat box." The 
second "hat" in this sentence, has a set of intonational 

15 values that denote its modifying . properties for an entity 
("box", the object) of the action segment ("was put into") 
of the sentence. In contrast, the first "hat" has a set of 
. intonational values that place it as the principle entity of 
the sentence as. a whole. The second "hat" in this second 

2 0 example sentence actually has a set of pitch, tone and volume 
values that is equivalent to the third "purple" in the first 
example sentence. 

These dimensions of intonality in speech, as stated 
above, have combinable and. commutable - values. . These 

25 dimensions of intonality are also transparent in that they 
are perceived simultaneously with the word unit that is 
carrying the individual word-meaning information: each .spoken 
word is therefore carrying a packet of both semantic and 
syntactic information. In this way, the dimensions of 

30 intonality are - non-annotat ive ; that is, they do not require 
additional utterance.. A person does not, for example, say 
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jDetore each phrase of a sentence. "Subject -the purple 
hat -modifier of subject-of the purple clown-verb-was put 
into-obj ect- the purple box. " 

However, the existing methods of representing the 
5 relationships between groups of words in a sentence, such as 
parse trees or grammatical diagrams, are not transparent, but 
instead rely on additional annotation and symbols to label 
the word groups. These labels, in turn, are fixed and do not 
combine or commute values across successive levels of 

10 sub-unit differentiation, or limit such values according to 
their context. 

It is therefore desirable that enhanced text 
presentation should enrich the appearance of the actual words 
of the text with visual attributes that are similar to the 

15 intonational attributes of speech. These visual attributes 
should create a multi-dimensional system of combinable and 
commutable values that represent attributes of the words in 
addition to their word-specific meanings. These visual 
attributes should also be transparent, i.e., perceivable 

20 simultaneously with the perception of the words themselves. 

Moreover, unless a text presentation method 
systematically assures that the author- specif ied sequence of 
words is unambiguously represented, it is not text 

25 presentation as meant in this discussion, but simply a method 
to demonstrate the results of some narrow aspect of text 
analysis which subordinates the integrity of the author's 
message to the objectives of such an analysis. 

The "Prose Paint" process described above uniquely 

30 represents these intonational conditions of speech in an 
unambiguous text presentation. In addition, the "Prose 
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Paint" process is a novel approach to syntactic analysis 
itself, in that the properties of entity, action, and 
modification, which represent the relationships between child 
and parent segments, also combine and commute across 
successive levels of differentiation of a sentence. 

In other words, it is not only that enhanced visual 
presentation of text should aspire to the conditions of 
speech, but that syntactic analysis itself should aspire to 
the conditions of intonality. A basic exercise for testing 
grammar rules in linguistic analysis is to create a series 
of words using the grammar rules and then to listen to the 
proposed sentence to determine if it "sounds right". It is 
possible, as illustrated by the previous discussion on 
intonational values, that the inner "reasoning" by which 
"complete sentences" are intuitively recognized as valid 
propositions is mediated by a multi- dimensional system of 
attributes for the relationships of sub-units to larger units 
whose outward expression is intonality. The mathematics of 
the mind may be musical. 

The method can- be used to display text using either the 
text folding described previously or using standard text 
displays, but in color. The method can also stop short of 
segmenting a sentence into words. For example, the algorithm 
can stop after a fixed number of levels, or leave phrases 
intact, leaving all words in the phrase with the same color. 

Numerous characteristics and advantages of the invention 
covered by this document have been set forth in the forgoing 
description. It will be understood, however, that this- 
disclosure is, in many respects, only illustrative. Changes 
may be made in details, particularly in matters of combining, 
separating, - and arranging steps, without exceeding the scope 



WO 99/39255 PCT/US99/02227 

of this invention. The invention's scope is, of course, 

defined in the language in which the appended claims are 
expressed . 
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What is claimed is: 

1. A method for enhancing presentation of text having 
an author specified word order comprising: 

a) extracting text specific attributes from said text; 

and 

b) varying said text presentation in accordance with 
said attributes, while substantially maintaining said author 
specified word order. 

2 . A method for enhancing text presentation as recited 
in claim 1, wherein said text specific attributes include 
text location within a text body, said text presentation 
includes background color, and said presentation includes 
varying said background color in accordance within said text 
location. 

3 . A method for enhancing text presentation as recited 
in claim 1, wherein said text specific attributes include a 
text difficulty measure, and said text presentation includes 
an automatic text advancement rate, and said presentation 
includes varying said text presentation rate in accordance 
within said text difficulty measure. 

4 . A method for enhancing text presentation as recited 
in claim 3, wherein said text difficulty measure includes an 
estimated pronunciation time of said text. 

5 . A method for enhancing text presentation as recited 
in claim 3, wherein said text difficulty measure includes an 
estimated educational level of said text . 
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6. A method for enhancing text presentation as recited 
in claim 1 wherein: 

a) said attributes include punctuation and parts of 
speech; 

b) extracting includes parsing said text into 
punctuation and parts of speech; 

c) said varied text presentation is implemented using 
rules having inputs and outputs; 

d) said rule inputs including said parts of speech; 

e) said enhanced text presentation includes visual 
attributes; and 

f) said rule outputs including said visual 
attributes . 

7. A method for enhancing text presentation as recited 
in claim 6 wherein: 

a) said rules include folding rules; 

b) said folding rules dividing said text into text 
segments; and 

c) said folding rule inputs include punctuation. 

8. A method for enhancing text presentation as recited 
in claim 7 wherein said folding rule inputs further include 
parts of speech. 

9. A method for enhancing text presentation as recited 
in claim 8 wherein said visual attributes include the. 
displaying of said text segments in a color depending on said 
parts of speech. 
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10. A method for enhancing text presentation as recited 
in claim 8 wherein said visual attributes include the 
displaying of said text segments on new lines. 

11. A method for enhancing presentation of text having 
an author specified text sequence comprising: 

a) extracting text specific attributes from said text; 

and 

b) varying said text presentation quantitatively in 
accordance with said attributes, while substantially 
maintaining said text sequence. 

12 . A method for enhancing text presentation as recited 
in claim 11, wherein said text presentation unambiguously 
represents said text sequence. 

13 . A method for enhancing text presentation as recited 
in claim 12, wherein said text presentation includes no non- 
textual symbols in association with said text. 

14. A method for enhancing text presentation as recited 
in claim 11, wherein said text is displayed in a perspective 
view such that text segments above other segments appear to 
be further away from the reader, such that in reading said 
text from bottom to top said text appears to be reading from 
front to back. 

15. A method for enhancing text presentation as recited 
in claim 11, wherein said text presentation includes display 
of a plurality of text segments, each of said text segment 
displays having a starting horizontal and vertical 
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displacement, wherein said - \ horizontal and vertical 
displacements are varied quantitatively in accordance with 
said attributes. 

16. A method for enhancing text presentation as recited 
in claim 11 wherein said attributes include punctuation and 
parts of speech . 

17. A method for displaying text including words, 
phrases, and sentences comprising: 

having a reader-performer read the text aloud,, wherein 
said reader-performer performs actions are selected from the 
group consisting of speaking, hand movement, eye movement, 
head movement , and mouth movement ; 

electronically recording said actions of said reader- 
performer corresponding to said text; 

displaying said text; 

varying said text display in accordance said reader- 
performer actions. 

18. A method for displaying text including words, 
phrases, and sentences as recited in claim 17 wherein said 
spoken speech attributes are recorded and said text display 
is varied in accordance with said spoken speech attributes. 

19. A method for displaying text as recited in claim 
18 wherein said spoken speech attributes are selected from 
the group consisting of pitch, tone, volume, and pauses 
between words . 
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20. A method for displaying text as recited in claim 
19 wherein said wherein said text display has display 
attributes varied in accordance with said spoken speech 
attributes and said display attributes are selected from the 
group consisting of font, intensity, font line thickness, 
font character height, inter-character spacing, inter-word 
spacing, inter-line spacing and inter-sentence spacing. 

21. A method for displaying text as recited in claim 
18 wherein said hand gestures are recorded and said text 
display is varied in accordance with said hand gestures. 

22. A method for displaying text as recited in claim 
21 wherein said hand gestures include hand position and 
orientation and finger position and orientation. 

23 . A method for displaying text as recited in claim 
21 wherein said text display includes modifying the 
horizontal displacement of said text as a function of the 
horizontal displacement of said hands and said text display 
includes modifying the vertical displacement as a function 
of said hand vertical displacement. 

24. A method for displaying as recited in claim 18 
wherein said facial gestures are recorded and said text is 
displayed in accordance with said facial gestures. 

25. A method for displaying text as recited in claim 
24 wherein said recorded facial gestures are selected from 
the group consisting of eye shape, eye openness, eyebrow 
position, and mouth shape. 
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26. A method for displaying text having text specific 
attributes comprising: 

generating a curved line; and . 
positioning said text on said curved line, 
wherein said curved line shape is a function of said 
text attributes. 

27. A method for displaying text as recited in claim 
26 wherein said curved line shape is a function of a reader- 
performer's recorded presentation selected from the group 
consisting of vocal pitch, vocal tone, vocal volume, hand 
gestures, and facial expressions. 

28. A method for displaying text as recited in claim. 
26 herein said curved line is substantially less visible than 
said displayed text. 

29. A method for displaying text as recited in claim 
26 wherein said curved line is invisible. 

30. A method for displaying multiple text hierarchies 
comprising: 

displaying a first hierarchy of text as a plurality of 
overlapping windows having exposed, . substantially parallel 
margins ; and 

displaying a second hierarchy of. text as a plurality of 
overlapping windows having exposed, substantially parallel 
margins, wherein said second hierarchy of text is lower in 
rank than said first hierarchy of text, wherein said second 
hierarchy margins are oriented at an" angle relative to said 
first hierarchy margins. 
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31. A method for displaying multiple text hierarchies 
as recited in claim 30 further comprising a selected window 
in said first hierarchy, wherein said selected window has 
said second hierarchy windows displayed within. 

32 . A method for displaying multiple text hierarchies 
as recited in claim 32 further comprising selecting a 
selected window in said second hierarchy, wherein said second 
selected window has text displayed within. 

33. A method for displaying multiple text hierarchies 
comprising : 

displaying a first hierarchy of text as a plurality of 
substantially vertically oriented overlapping windows having 
exposed horizontal margins; and 

displaying a second hierarchy of text as a plurality of 
substantially horizontally oriented overlapping windows 
having exposed vertical margins, wherein said second 
hierarchy of text is lower in rank than said first hierarchy 
of text . 

34. A method for displaying multiple text hierarchies 
comprising: 

displaying a first hierarchy of text as a plurality of 
substantially horizontally tiled planes; 

displaying a second hierarchy of text as a plurality of 
substantially vertically tiled planes, wherein said second 
hierarchy of text is lower in rank than said first hierarchy 
of text. 
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35. A method for displaying multiple text hierarchies 
comprising: 

displaying a series of text hierarchies as alternating 
horizontally tiled ■ plane sets and vertically ' tiled plane 
sets. 

36. A method for displaying multiple text hierarchies 
as recited in claim 35 wherein said series , of text 
hierarchies is selected from the group consisting of volumes, 
chapters, sections, paragraphs, and sentences. 

37. A method for displaying multiple' text hierarchies 
as recited in claim 3 5 further comprising allowing a human 
reader to select a unit of text in said hierarchies, wherein 
when said selected unit is substantially horizontally tiled 
said units move apart substantially vertically, wherein when 
said selected unit is substantially vertically tiled said 
units move apart substantially horizontally, such that said 
selected unit is further away from at least one other 
adjacent unit after said movement. 

38. A method for displaying multiple text hierarchies 
as recited in claim 39 wherein a lower hierarchy is displayed 
after said units move apart. 

39. A method for displaying multiple text hierarchies 
as recited in claim 38 wherein said lower hierarchy is .tiled 
horizontally when said moved apart hierarchy is tiled 
vertically and said . lower hierarchy is tiled vertically when 
said moved apart hierarchy is tiled horizontally. 
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40 . A method for displaying multiple text hierarchies 
as recited in claim 35 wherein said sentences are represented 
as a series of vertically tiled pages, wherein, when a 
sentence unit is indicated as having been read, said pages 
slides to the left, such that a page previously at least 
partially underneath is exposed for reading. 

41. A method for displaying text comprising: 
displaying a left page having text content, a right 

margin and a left margin, 

displaying a right page having text content, a right 
margin and a left margin, 

wherein said left page right margin substantially 
overlies said right page left margin while said left page is 
being read and said right page left margin substantially 
overlies said left page right margin while said right page 
is being read. 

42 . A method for displaying text as recited in claim 
41 further comprising 

removing said left page content when said left page has 
been read and exposing a subsequent left page content, and 

removing said right page content when said right page 
has been read and exposing a subsequent right page content, 

such that a text segment extending from one page to a 
subsequent page can be read without requiring scrolling to 
read said text segment content extending to said subsequent 
page . 
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43 . A method for displaying text as recited in claim 
42 wherein said page being read is indicated by reader 
. action. 

44. A method for displaying text as recited in claim 
42 wherein said page being read is indicated by an estimate 
of reading speed based at least in part on time. 

45. A method for displaying text having an original 
sequence comprising: 

segmenting said text into a plurality of segments; and 
displaying said segments on a plurality ' of lines, 
wherein reading said text from bottom to top 
substantially preserves said original sequence, 

wherein said .text is displayed in a perspective view 
such that text segments above other segments appear to be 
further away from the reader, such that in reading' said text 
from bottom to top said text appears to be reading from front 
to back. 

46. A method as recited in claim 45 wherein said text 
is displayed, in a font decreasing in size from bottom lines 
to top lines of text. 

47. A method as recited in claim 45 further comprising 
placing a- partially translucent virtual lens over text above 
the lower line being read, such that text above said lower 
line is visible but less, easily read then the text below the 
line. 
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48. A method as recited in claim 45, wherein the text 
above said certain line is less bright than the text line 
being read. 

49. A method as recited in claim 45 wherein said text 
in a line being read is removed after indicated as read and 
a line of text immediately behind said line being read is 
displayed to appear closer to the reader, such that the 
reader appears to be moving forward through the text being 
read. 

50. A method for displaying text comprising the steps 

of: 

providing text encoded as follows 

a. analyzing a sentence, subdividing said sentence 
into a plurality of text segments based on relationships of 
said text segments to each other, 

b. organizing said text segments into a tree having 
a root parent node and a plurality of parent nodes and child 
nodes ; 

c. assigning each child node an attribute based on the 
relationship with the parent node of said child; 

d. assigning said root node a color; 

e. for each child node beneath the root node, 
assigning a color to each child node based upon the color of 
the parent node and modified by the relationship between the 
child node and the parent node ; 

f . repeating step e until all -nodes have a color 
assigned; 
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g. displaying said text in lines in substantially the 
same order specified by the author using the color assigned 
in the tree. 

51. A method as recited in claim 50 further wherein 
said parent -child relationships are selected from the group 
consisting of entity, action and modification. 

52 . A method for . enhancing text- presentation 

comprising: 

a) providing folding rules utilizing parts of speech 
and punctuation marks, wherein said folding rules 
include primary rules and secondary rules, said 
primary rules utilizing punctuation marks and said 
secondary rules utilizing parts of speech, wherein 
said secondary folding rules include a micro- 
grammar, for disambiguating the parts of speech; 

b) providing text segment horizontal displacement 
■ rules, wherein the rules utilize parts of speech; 

c) providing a minimum text segment length; 

d) providing a maximum text segment length; 

e) parsing said text into words ' and punctuation 
marks ; 

f) determining the likely parts of speech of the 
words from step e; 

g) determining primary folding point locations in 
said text by applying the primary folding rules, 
thereby dividing said text into super-phrases; 

h) determining secondary folding point locations in 
the super-phrases by applying the secondary 
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folding rules, thereby dividing the super-phrases 
into text segments; 

i) repeating step h until all text segments are no 
greater than the maximum text segment length, and 
no less than the minimum text length; 

j ) applying the text segment horizontal displacement 
rules to the text segments, thereby determining 
the horizontal displacement for each text segment; 

k) mapping each of said text words to an audio 

recording of said text words; and 

1) playing back said recorded text words, inserting 

pauses in accordance with said horizontal 
displacement. 



115 



WO 99/39255 



PCT/US99/02227 



NO 



Fis.l 



START 

v GIVEN TEXT FILE AND READER IDS, 



RETRIEVE READER SPECIFIC 
PARAMETERS 



RETRIEVE SELECTED TEXT FILE 
AND RELATED TEXT FILE SPECIFIC 
PARAMETERS 



ACCEPT AND STORE READER 
SPECIFIED PARAMETERS FOR TEXT 
PRESENTATION 



PREPROCESS TEXT 



APPLY HORIZONTAL 
DISPLACEMENT RULES 



CREATE ENHANCED TEXT 



PRESENT ENHANCED TEXT 



ACCEPT READER SPECIFIED EDITS 



STORE READER SPECIFIED EDITS 



CLEAN UP 
END 



102 



104 



106 



108 



-110 
.111 

112 
- 113 

-114 

116 




118 



120 



1/27 

SUBSTITUTE SHEET (RULE 26) 



WO 99/39255 



PCT/US99/02227 



Fig. 2 



Self 


ELEMENT 


TYPE 


PM 
CAT. 


WORD 
POS, 
DICT 


WORD 
POS, 
M6 


WORD 
CAPIT- 
ALIZED 


It 

CHAR- 
ACTERS 


H 

SYLLA- 
BLES 


PRON- 
UNCIA- 
TION 
TIME, 
SECONDS 


EDUC- 
ATION 
LEVEL 


1 


1 


W 




PRON. 




YES 


1 


1 


.5 


1 


2 




S 


















3 


had 


w 




VERB 






3 


1 


.25 


1 


4 




s 


















5 


a 


w 




ARTICLE 






1 


1 


.25 


1 


6 




s 


















7 


farm 


w 




N-V-A 


NOUN 




4 


1 


.75 


1 


8 




s 


















9 


in 


w 




PREP 






2 


1 


.25 


1 


10 




s 


















11 


Africa 


w 




NOUN 




YES 


6 


3 


1.0 


3 


1 9 
I L 




rsnji 

rM 


COMMA 








1 




.5 




13 




S 














.5 




14 


at 


w 




PREP 






2 


. 1 


.25 


1 


15 




s 


















16 


the 


w 




ARTICLE 






3 


1 


.25 


1 


17 




s 


















18 


foot 


w 




N-V-A 


NOUN 




4 


1 


.5 


1 


19 




s 


















20 


of 


w 




PREP 






2 


1 


.25 


1 


21 




s 


















. 22 


the 


w 




ARTICLE 






3 


1 


.25 


1 


23 




s 


















24 


Ngong 


w 




NOUN 




YES 


5 


2 


1.0 


12 


25 




s 


















26 


Hills 


w 




NOUN 




YES 


5 


1 


.75 


2 


27 




PM 


PERIOD 












.5 





2 / 27 

SUBSTITUTE SHEET (RULE 26) 



-WO 99/39255 



PCT/US99/02227 



on 



o 



GO 
O 

o 

?-( 

O 
<D 

CD 
43 

H 



d 

CD 
r-{ 

«*-> 

o 
» 

43 

CD 
r-} 

CD 
43 

4— > 

*3 



CD 
Q-, 

O 
go 

a 

CD 

CD 
J— < 

O 



CD 



o 

o 



CD 



CO 



O 

a 

43 
43 



2 

o 

CD 
43 



a3 



3 / 27. 
SUBSTITUTE SHEET (RULE 26) 



WO 99/39255 



PCT/US99/02227 



C3 
O 



O 

o 

5— ( 

o 

CD 
&0 

CD 



CD 
CD 



CD 

o 



-a 

03 



CD o 

o — ' 

12 - 



CD 

CD 
O 



X3 
CD 
C3 



O 
O 



o 
a 

03 

4- > 



2 

O 



4 / 27 

SUBSTITUTE SHEET (RULE 26) 



WO 99/39255 



PCT/US99/02227 



Fig. 5 

© 



GET ONE SENTENCE OF TEXT 



TOKENIZE INTO WORDS AND 
PUNCTUATION 



LOOK UP POSSIBLE PARTS OF 
SPEECH, NUMBER OF SYLLABLES 

EDUCATIONAL LEVEL AND 
PRONUNCIATION TIME 



LOOK UP WORDS IN READER 
SPECIFIC AND TEXT SPECIFIC 
WORD SETS 



I 



DISAMBIGUATE MULTIPLE PARTS 
OF SPEECH 



ASSIGN REMAINING POSSIBLE 
PARTS OF SPEECH, NUMBER OF 
SYLLABLES, EDUCATIONAL LEVEL 
AND PRONUNCIATION TIM AS 
PROPERTIES OF WORDS, THEREBY 
CREATING ENRICHED SENTENCE 



LOOP THROUGH ENRICHED 
SENTENCE, 
APPLY PRIMARY FOLDING POINT 
RULES USING PUNCTUATION 
ASSIGN PRIMARY FOLDING POINTS 



LOOP THROUGH ENRICHED 
SENTENCE, 
APPLYING SECONDARY FOLDING 
RULES USING PARTS OF SPEECH 
CREATE TEXT SEGMENTS BASED 
ON FOLDING POINTS, MINIMUM AND 
MAXIMUM LINE LENGTHS 




• 110 




122 



124 



126 



128 



130 



132 



134 



136 



5/27 

SUBSTITUTE SHEET (RULE 26) 



WO 99/39255 



PCT/US99/02227 



Fig. 6 



CLASS 1, SUBCLASS 1 
PREPOSITIONS 


AMID, BESIDES, AGAINST, AMONG, ABOUT BY 
(WITH GERUND), DURING, SINCE, THROUGHOUT 
WITHIN, UNTO, ALONG, EXCEPT, AROUND, 
THROUGH UNTIl WITHOUT 


•CLASS 1, SUBCLASS 2 
'CONJUNCTIONS 


ALTHOUGH, AS THOUGH, UNLESS, UNTIL, AS IF 
SO THAT, IN ORDER THAT, BECAUSE, BUT 


CLAoS 1, SUBCLASS 3 
RELATIVE PRONOUNS 


TO WHOM, TO WHOEVER 


PI A^c; 1 CI IDpl ACC A 

OTHER 


RATHER THAN, IN LIEU OF, INSTEAD OF 


CLASS 2 SUBCLASS 1 
PREPOSITIONS 


noUVC, DCrUKt, CStlNcA 1 H, DtZ 1 VVcfcrN , Ur, 

ACROSS. TOWARD, UPON, AFTER, UNDER, 
TO (WITH VERB) 


CLASS 2, SUBCLASS 2 
CONJUNCTIONS 


WHEN, WHERE, WHENEVER, WHEREVER, WHILE, 
AND (WITH RESTRICTIONS), OR (WITH) 
RESTRICTIONS), IF 


CLASS 2, SUBCLASS 3 
RELATIVE PRONOUNS 


WHAT, WHOM, WHICH, WHO, WHOSE 


CLASS 2, SUBLCLASS 4 
OTHER 


NOUNA/ERB INTERFACES, ADVERBS FOLLOWING 
A VERB 


CLASS 3, SUBCLASS 1 
PREPOSTIONS 


FOR, AT, TO (WITH NON-VERBS), WITH, OF, IN, 
BY (WITHOUT GERUND), FROM, ON 



6/27 

SUBSTITUTE SHEET (RULE 26) 



WO 99/39255 PCT/US99/02227 



Fig. 7 



CLASS 3 
SECONDARY 
FOLDING 
POINT 



PRIMARY 
(COMMA) 
FOLDING 
POINT 



CLASS 3 
SECONDARY 
FOLDING 
POINT 



I had a farm in Africa, at the foot of the Ngong Hills. 

MINIPHRASE 1 MINIPHRASE 2 MIMPHRASE 1 MINIPHRASE 2 
< > < > < > < > 



SUPERPHRASE 1 



SUPERPHRASE 2 



II 27 

SUBSTITUTE SHEET (RULE 26) 



WO 99/39255 



PCT/US99/02227 



Fig. 8 



If SP = SUPER-PHRASE 

// SFR = SECONDARY FOLDING RULE 

// MIN = MINIMUM LINE LENGTH 

// MAX = MAXIMUM LINE LENGTH 

FOR ALL SP IN SENTENCE 

FOR ALL LEVELS OF SFR. FROM LOW TO HIGH 
FOR ALL WORDS IN SP, FROM LEFT TO RIGHT 
IF RESULTING TEXT SEGMENT WOULD BE > MIN 
APPLY SFR. CREATING NEW TEXT SEGMENT 
ELSE 

DO NOT APPLY SFR THEREBY \ 
ADDING TO LENGTH OF NEXT \ 
TEXT SEGMENT 
ENDIF 

END FOR ALL WORDS IN SP 
END FOR ALL LEVELS OF SFR 
END FOR ALL SP IN SENTENCE 

FOR ALL TEXT SEGMENTS CREATED 

WHILE TEXT SEGMENT LENGTH IS > MAX 
APPLY COLLAPSE RULE THEREBY \ 
CREATING MULTIPLE TEXT SEGMENTS 
END WHILE 
END FOR ALL TEXT SEGMENTS CREATED 



8 / 27 

SUBSTITUTE SHEET (RULE 26) 



WO 99/39255 PCT/US99/02227 



Fig. 9 



SUPERPHRASE 1 
M ► 

MP1 MP 2 

-> < -> 



I had a farm in Africa, 



at the foot 
< > 

of the Ngong Hills. 

< — 2 _> 



FOLDED SUPERPHRASE 2 



9 / 27 

SUBSTITUTE SHEET (RULE 26) 



WO 99/39255 



PCT/US99/02227 




10 / 27 
SUBSTITUTE SHEET (RULE 26) 



WO 99/39255 



PCT/US99/02227 



Fig. 11 



I 



had 



farm 



in 



Af -206 

Afn— 207 
ca. 



200 



at 



the 



foot 



S 



•202 



of 



the 



N 



gong- 
gong - 



208 
209 



203 



Hills. 



11 / 27 
SUBSTITUTE. SHEET (RULE 26) 



WO 99/39255 PCT/US99/02227 



CM ■■- 


Lane 5 


a 










ginning of word in B; text after word on new row In D 






X 


X 


Beginning of word in B; text after word on new row In D 


X 


CM O 


o 








X 


X 


X 








t- a> 


a 


X 


X 


X 














00 


< 




















T- h» 


Lane 4 


a 














X 


X 


X 


T- tO 


o 








X 


X 


X 








•— U3 


CO 


X 


X 


X 
















< 




















y- CO 


Lane 3 1 


a 














X 


X 


X 


i- CM 


o 








X 


X 


X 










ca 


X 


X 


X 
















< 




















OS 


Lane 2 


a 














X 


X 


X 


00 


o 








X 


X 


X 










CD 


X 


X 


X 














<0 


< 










9 

a 














Lane 1 


a 


Lane 1 used 
for 

punctuation 
mark- 
directed 
Indents only; 
see steps 
1-15 




a 


CO 


CD 


CM 


< 


£L 
CO 


X 


Slot 


o 
2 


o 

CM 
jQ 


o 

CO 


o 
•<*■ 
.a 


in 


o 
m 
x> 


o 

(O 

.a 


o 


o 

00 
.Q 


m 

00 
.£3 


o 

.O 





12 / 27 
SUBSTITUTE SHEET (RULE 26) 



WO 99/39255 



PCT/US99/02227 



342 



A 



y 



340 



344 



H 


1 








J 


K 









\E\ 






13 / 27 
SUBSTITUTE SHEET (RULE 26) 



WO 99/39255 PCT/US99/02227 



350 



Head 


1 ail 


Description of 
circumstances 
at beginning 
(Head) of 
segment (Tail), 
to right. 


H 




J 


K 


Split 
be- 
tween 
words 


Comma, 
doupie - 
dash 

The tical 
or .quo- 
tation 
marks r at 
end ot 
segment 


Colon, 
semi- 
colon, or 
ellipse- at 
end of 
segment 


End 
of 

sen- 
tence 


A 


Beqmninq of 
Sentence 


A-H 


A-l 


A- J 


A-K 


B 


Co.lon. semi,- 
colon or el- 
lipse . preced- 
ing the 
s ^g m e n t 


B - H 


B -1 


B - J 


B-K 


C 


Comma, doubledash. 
parenthetical .or 
buotat.ion marks at 
beqinnmq ot. or 
prercedirrg segment 


C-H 


C-l 


C- J 


C-K 


D 


Words jDlO-.bJja. on 
Hinge Word list 


U - H 


n - 1 

u \ 




n - k 


E 


Words 1 b40 J -b.49 on 
Hinge Word list 


E-H 


E-l 


E- J 


E-K 


F 


Words ^50,-0,79 on 
JHingg ^vord list 


F-H 


F-l 


F- J 


F-K 


G 


Words ^80,-0,95 on 
Hinge Word list 


G-H 


G-l 


G- J 


G-K 



G. \A 



14 / 27 
SUBSTITUTE SHEET (RULE 26) 



WO 99/39255 PCT/US99/02227 



JZ - ZSZ ^ 




o 



15 / 27 
SUBSTITUTE SHEET (RULE 26) 



PCT/US99/02227 



406 




FIG. 16 



16 / 27 
SUBSTITUTE SHEET (RULE 26) 



WO 99/39255 



PCT/US99/02227 




17 I 21 
SUBSTITUTE SHEET (RULE 26) 



WO 99/39255 



PCT/US99/02227 




18 / 27 
SUBSTITUTE SHEET (RULE 26) 



WO 99/39255 



PCT/US99/02227 



/ 



o 



CO 

o 

CM 



CM 
CM 



~7 



z: 



0. w 



cn 



CD 



CM 



19/ 27 
SUBSTITUTE SHEET (RULE 26) 



WO 99/39255 PCT7US99/02227 




20 / 27 
SUBSTITUTE SHEET (RULE 26) 



WO 99/39255 



PCT/US99/02227 



CM 
O 



CO 

X 

o 



55 



CM 



CO 

< 

a. i 



CO 



CM 



CO 
CVJ 



CL r- 



(SI 
CYJ 

CD 

I 1 



CM 



21 / 27 
SUBSTITUTE SHEET (RULE 26) 



WO 99/39255 



PCT7US99/02227 



X 

u 



XX 



CVi 
CVS 




X 



£L CI 



CVJ 



i — i 



22 / 27 
SUBSTITUTE SHEET (RULE 26) 



WO 99/39255 



PCT/US99/02227 




23 / 27 
SUBSTITUTE SHEET (RULE 26) 




24 / 27 
SUBSTITUTE SHEET (RULE 26) 



WO 99/39255 



PCT/US99/02227 




25 / 27 
SUBSTITUTE SHEET (RULE 26) 



WO 99/39255 



PCT/US99/02227 




WO 99/39255 



PCT/US99/02227 




oq:<z 



27 / 27 
SUBSTITUTE SHEET (RULE 26) 



WORLD INTELLECTUAL PROPERTY ORGANIZATION 
Internationa! Bureau 




PCT 

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) International Patent Classification 6 : 
G06F 17/21 



A3 



(11) International Publication Number: 
(43) International Publication Date: 



WO 99/39255 

5 August 1999 (05.08.99) 



(21) International Application Number: PCT/US99/02227 

(22) International Filing Date: 2 February 1999 (02.02.99) 



(30) Priority Data: 

09/016,902 



2 February 1998 (02.02.98) 



US 



(71)(72) Applicant and Inventor: WALKER, Randall, C. [US/US]; 
923 Tenth Street S.W., Rochester, MN 55902 (US). 

(74) Agents: SIVERTSON, Wayne, A. et al.; Nawrocki, Rooney 
& Sivertson, P.A., Suite 401, 3433 Broadway Street N.E., 
Minneapolis, MN 55413 (US). 



(81) Designated States: AL, AM, AT, AU, AZ, BA, BB, BG, BR, 
BY, CA, CH, CN, CU, CZ, DE, DK, EE, ES, FI, GB, GD, 
GE, GH, GM, HR, HU, ID, IL, IN, IS, JP, KE, KG, KP, 
KR, KZ, LC, LK, LR, LS, LT, LU, LV, MD, MG, MK, 
MN, MW, MX, NO, NZ, PL, PT, RO, RU, SD, SE, SG, 
SI, SK, SL, TJ, TM, TR, TT, UA, UG, UZ, VN, YU, ZW, 
ARIPO patent (GH, GM, KE, LS, MW, SD, SZ, UG, ZW), 
Eurasian patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), 
European patent (AT, BE, CH, CY, DE, DK, ES, FI, FR, 
GB, GR, IE, IT, LU, MC, NL, PT, SE), OAP1 patent (BF, 
BJ, CF, CG, CI, CM, GA, GN, GW, ML, MR, NE, SN, 
TD, TG). 



Published 

With international search report. 
Before the expiration of the time limit for amending the claims 
and to be republished in the event of the receipt of amendments, 

(88) Date of publication of the international search report: 

16 September 1999(16.09.99) 



(54) Title: TEXT PROCESSOR 
(57) Abstract 



A text enhancement method (1) and apparatus (17) for 
the presentation of text for improved human reading. The 
method (I) includes extracting text specific attributes from 
machine readable text and varying the text presentation in 
accordance with the attributes (2). The preferred embodiment 
of the method (1): extracts parts of speech and punctuation 
from a sentence, applies folding rules which use the parts of 
speech to determine folding points (6), and presents text 
segments (14) each on a new line and having a determined 
horizontal displacement (12) based on the text specific 
attributes (2). One method displays text over bent curves 
having a shape based on text content (16). Another method 
includes displaying relative text position within a hierarchy 
using alternating vertically and horizontally tiled planes. 
Another method supports reading text segments across 
opposed pages without waiting for paging (23). Yet another 
method displays text to allow reading from bottom to top as 
though from front to back (25). Still another method displays 
words in colors reflecting the relationships between the words 
and the larger text segments of which they are apart (27). 



(gi\ 



START 

GIVEN TEXT FILE AN0 READER IDS 



RETRIEVE READER SPECIFIC 
PARAMETERS 



RETRIEVE SELECTED TEXT FILE 
AND RELATED TEXT FILE SPECIFIC 
PARAMETERS 



ACCEPT ANO STORE READER 
SPECIFIED PARAMETERS FOR TEXT 
PRESENTATION 



PREPROCESSTEXT 



J -"0 



APPLY HORIZONTAL 
DISPLACEMENT RULES 



(accept reao£r|sp£Cifieo epos^ X"^ 



CREATE ENHANCED TEXT 



PRESENT ENHANCED TEXT 



112 
U3 




FOR THE PURPOSES OF INFORMATION ONLY 



Codes used to identify States party to the PCT on the front pages of pamphlets publishing international applications under the PCT. 



AL 


Albania 


ES 


. Spain 


LS 


Lesotho 


SI 


Slovenia 


AM 


Armenia 


FI 


Finland 


LT 


Lithuania 


SK 


Slovakia 


AT 


Austria 


FR 


France 


LU 


Luxembourg 


SN . 


Senegal 


AU 


Australia 


GA 


Gabon 


LV 


Latvia 


SZ 


Swaziland 


AZ 


Azerbaijan 


GB 


United Kingdom 


MC 


Monaco 


TD 


Chad 


BA 


Bosnia and Herzegovina 


GE 


Georgia 


MD 


Republic of Moldova 


TG 


Togo 


BB 


Barbados 


GH 


Ghana. 


MG 


Madagascar 


TJ 


Tajikistan 


BE 


Belgium 


GN 


Guinea 


MK 


The former Yugoslav 


TM 


Turkmenistan 


BF 


Burkina Faso 


GR 


Greece 




Republic of Macedonia 


TR 


Turkey 


BG 


Bulgaria 


HU 


Hungary 


ML 


Mali 


TT 


Trinidad and Tobago 


BJ 


Benin 


IE 


Ireland 


MN 


Mongolia 


UA 


Ukraine 


BR 


Brazil 


1L 


Israel 


MR 


Mauritania 


UG 


Uganda 


BY 


Belarus 


IS 


Iceland 


MVV 


Malawi 


US 


United States of America 


CA 


Canada 


IT 


Italy 


MX 


Mex ico 


UZ 


Uzbekistan 


CF 


Central African Republic 


JP 


Japan 


NE 


Niger 


VN 


Viet Nam 


CG 


Congo 


KE 


Kenya 


NL 


Netherlands 


YU 


Yugoslavia 


CH 


Switzerland 


KG 


Kyrgyzstan 


NO 


Norway 


ZW 


Zimbabwe 


CI 


Cote d'lvoire 


KP 


Democratic People's 


NZ 


New Zealand 






CM 


Cameroon 




Republic of Korea 


PL 


Poland 






CN 


China 


KR 


Republic of Korea 


PT 


Portugal 






cu 


Cuba 


KZ 


Kazakstan 


RO 


Romania 






cz 


Czech Republic 


LC 


Saint Lucia 


RU 


Russian Federation 






DE 


Germany 


LI 


Liechtenstein 


SD 


Sudan 






DK 


Denmark 


LK 


Sri Lanka 


SE 


Sweden 






EE 


Estonia 


LR 


Liberia 


SG 


Singapore 







INTERNATIONAL SEARCH REPORT 



International application No. 
PCT/US99/02227 



A. CLASSIFICATION OF SUBJECT MATTER 
1PC(6) :G06F 17/21 
US CL :707/529 

According to International Patent Classification (IPC) or to both national classification and IPC 



a FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 
U.S. : 707/529 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) 
AP 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 



Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



X 



A 
A 
A 
A 



US 5,600,765 A (ANDO et al) 04 February 1997, coi. 12, 11. 63- 
67; col. 2, 11. 1-65; col 1, 11 7-10; col. 3, 11. 22-35; col. 9, 11. 10-54. 



US 5,392,387 A (FITZPATRICK et al) 21 February 1995, FIG. 2; 
FIG. 3 & FIG. 4. 

US 5,463,725 A (HENCKEL et al) 31 October 1995. 
US 5,283,864 A (KNOWLTON) 01 February 1994. 
US 5,581,670 A (BIER et al) 03 December 1996. 
US 5,594,809 A (KOPEC et al) 14 January 1997. 



1, 3, 9, 11-13, 
16-22, 24, 25 



31-35; 37-39 

1-52 
47 
1-52 
1-52 



Further documents are listed in the continuation of Box C. | | See patent family annex. 



• Special categohei of cited documenU: 

"A" document defining the general state of the an which it not considered 

lo be of particular relevance 

*E* earlier document published on or after the international filing date 

•L" document which may throw doubta on priority cleim(i) or which is 

cited u> establish the publication date of another citauon or other 
•pecial reason (as specified) 

•O" document referring to an oral disclosure, use. exhibition or other 

means 

"P" document published prior to the intemauonal Tiling data but later than 

the priority date claimed 



"T" later document published after the international filing date or priority 

daie and not in conflict with the application but cited to understand 
the principle or theory underlying the invention 

•X* document of particular relevance; the claimed invenuon cannot be 

considered novel or cannot be considered to involve an inventive step 
when the document is taken alone 

*Y" document of parucular relevance; the claimed invenuon cannot be 

considered to involve an inventive step when the document is 
combined with one or more other such documents, luch combination 
being obvious to a person skilled in the art 

"A" document member of the same patent family 



Date of the actual completion of the international search 



23 MARCH 1999 



Date of mailing of the international search report 



22 JUL1999 



Name and mailing address of the ISA/US 
Commissioner of Patents and Trademarks 
Box PCT 

Washington, D.C. 20231 
Facsimile No. (703) 305-3230 



Authorized officer *— 

JOSEPH FEILD \J&*^- 
Telephone No. (703) 305-3801 



Form PCT/ISA/210 (second sheel)(July 1992) * 



INTERNATIONAL SEARCH REPORT 



international application No. 
PCT/US99/02227 



C (Continuation). DOCUMENTS C6NSIDERED TO BE RELEVANT^. 



Category* 



Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



A 
A 

a,p 



US 5,475,843 A (HALVIATTI et al) 12 December 1995. 

US 5,430,873 A (ABE et al) 04 July 1995. 

US 5,802,533 A (WALKER) 01 September 1998. 



1-52 
1-52 
1-52 



Form PCT/ISA/210 (continuation of second sheetj(July 1992)* 



